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ABSTRACT 


The  United  State?  Coast  Guard  has  implemented  a  perfor¬ 
mance  appraisal  system  intended  to  enable  personnel  boards 
within  the  service  to  fairly  select  roast  Guard  officers 
(for  promotion,  assignment,  and  schooling),  while  also 
providing  for  the  professional  development  and  counseling  of 
the  officers.  This  system,  the  Officer  Performance 
Management  System  (OPMS),  is  based  largely  on  the  principles 
of  management  by  objectives  (MBO)  and  incorporates  -he  use 
of  behaviorally  anchored  rating  scales  (SABS)  in  the  process 
of  performance  evaluation. 

In  an  effort  to  assess  the  current  attitudes  cf  ccas~ 
Guard  officers  c  crcernina  the  Office:  Performance  Maragemen': 
System  (OPMS)  ,  the  author  has  administered  a  survey  *o  a 
random  sample  cf  fi  ve-hur.ic  ed  active  du*y  Coast  Guard  offi¬ 
cers.  This  sample  was  drawn  from  pa)  grades  01  through  06 
and  is  further  stratified  by  career  fi«ld  ar.d  geographic 
area  of  assignment.  The  survey  attempts  to  measure  reac¬ 
tions,  attitudes,  and  specific  areas  of  knowledge  relevant 
to  the  OPMS. 

The  survey  responses  depict  only  limited  acceptance  of 
the  OPMS.  Hurdle  ;  which  obis  sysrem  Tiust  successfully  bridge 
may  be  basically  perceptual  in  nature.  However,  perceptions 
often  drive  realities  ir.  organisations  such  as  the  Coast 
Guard  and  thus  must  not  be  ignored.  Factors  that  may  be  of 
concern  for  the  Coast  Guard  include  perceptions  of  (1)  non 
uniform  applications  (2)  minimum  return  on  effort,  (3\ 
interference  with  pre-existing  priorities,  (U)  conflict  with 
the  organizational  context  cf  the  service,  (5)  system 
inequity,  and  (6)  lack  of  support  foe  OPMS  by  the  organiza¬ 
tional  reward  structure  ,  among  others. 
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I.  INTRODUCTION 


A.  PURPOSE 

The  purpose  cf  this  Thesis  was  to  perforin  an  assessment 
of  the  current  attitudes  and  perceptions  of  U.S.  Coast  Guard 
officers  concerning  The  recently  implemented  Officer 
Performance  Management  System  (OPMS)  .  This  assesmer.t  was 
accomplished  by  using  the  results  of  a  survey  instrument 
designed  and  administered  by  the  author  to  a  sample  of 
five-hundred  (50C)  Coast  Guard  officers.  The  resultant 
analyses  depicted  areas  cf  common  perception  as  well  as 
areas  of  diversified  opinion. 

One  hope  guiding  this  thesis  effort  was  that  the  find¬ 
ings  would  support  the  optimism  expressed  by  the  Coast  Guard 
Headquartes  Staff,  (G-GPSS),  that  the  OPMS  is  well  accepted 
by  the  officer  corps.  If  this  were  indeed  the  case,  then 
this  thesis  would  lend  credence  tc  the  optimistic  attitudes 
of  the  Headquarters  Staff. 

If  the  survey  results  turned  cut  tc  be  unsupporti ve, 
however,  then  it  would  appear  than  the  Officer  Performance 
Management  System  (CFMS)  might  be  encountering  resistance  by 
the  officer  corps.  Hopefully,  the  survey  results  would 
identify  areas  of  signifies  r.+  resistance  if  they  exist. 
Likewise,  areas  cf  significant  support  for  the  OPMS  could  be 
identified. 

The  basic  hypothesis  of  this  thesis,  then,  is  than  the 
attitudes  of  the  Coast  Guard  officer  corps  in  general  are 
consistent  with  the  opinions  expressed  by  staff  elements  of 
Coast  Guard  Headquarters,  (G-P-3),  relarive  to  the  accep¬ 
tance  and  efficacy  of  OPMS  as  a  viable  instrument  for 
evaluation,  appraisal  and  development  of  the  Coast  Guard 
officer  corps. 
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•  Author Iz  ?t  ion  and  Devel opment 

This  study  was  done  with  the  concurrence  and  direc¬ 
tion  of  the  Coast  Guard  Headquarters  Evaluation  Group  and 
staff  (G-P-3)  .  In  compliance  with  minimum  guidelines  estab¬ 
lished  ty  this  group,  as  related  through  cwo  s.3. 

Wehrenberg,  U.S.C.G.,  the  author  developed  a  survey  instru¬ 
ment.  This  instrument  was  administered  by  the  author.  Data 
analysis  was  conducted  at  the  Naval  Postgraduate  School, 
Monterey,  California,  computer  facilities  using  the 
Statistical  Package  fcr  the  Social  Sciences  (SPSS)  as 
adapted  for  the  IBM  3033  computer.  When  completed,  duplicate 
data  summaries  were  prepared  and  forwarded  tc  Coast  Guard 
Headquarters,  (G-P-3),  Washington,  D.  C,  . 

2.  The  Study  Ccr.cept 

From  the  onset  of  the  officer  performance  evalua¬ 
tion,  essentially  from  the  beginning  of  World  War  I,  the 
Coast  Guard  has  used  the  term  "Officer  Fitness  Hepcrting"  tc 
describe  the  reporting  processes,  with  the  implementation  of 
the  Officer  Performance  Management  System,  the  term  was 
changed  tc  M  Officer  Performance  Reporting  ",  The  function 
of  evaluation  is  described  in  terms  of  process  rather  than 
function.  These  subtle  changes  in  terms  address  more  exactly 
the  functions  of  the  reports  and  the  rating  officials. 
Officers  who  now  evaluate  others  are  reminded  by  the  titles 
that  they  are  reporting  on  their  performance  of  military 
duties,  and  in  sc  doing,  on  their  implied  ability  to 
perform  future  duties.  Reporting  officers  are  answering  the 
basic  questions  cf  "Hew  did  the  officer  do  the  duties 
assigned?",  and  "How  can  the  officer  do  the  duties 
assigned?". 
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Ir.  order  to  answer  these  questions,  the  0PM5  uses 
three  forms  which  are  applied  using  the  techniques, 
concepts,  and  principles  of  management  by  objectives  (I'.'eo) . 
The  OPUS  is  ambitious  in  scope  and  length;  it  is  the  devel¬ 
opmental  brain-child  of  Headquarters  (G-OPES)  staff.  This 
office  was  responsible  for  the  design  and  implementat  ior.  of 
the  OPUS  .  Further,  this  office  and  the  same  individuals  are 
responsible  for  the  monitoring,  analysis,  revision,  and 
final  evaluation  of  the  success  or  failure  of  the  CPKS 
within  the  service.  It  is  expected  that  these  individuals 
would  have  some  degree  of  ownership  in  the  ultimate  success 
of  the  system. 

Thus,  the  results  of  this  study  may  be  read  with  the 
keenest  interest  in  the  office  cf  3-P-3.  Data  and  analyses 
which  support  their  analysis  will  lend  credibility  tc  these 
analyses.  Conversely,  data  and  analysis  which  do  not 
support  their  findings  may  give  rise  to  additional  research 
and  analyses. 

3 .  Organ iza  Hon 

This  thesis  presupposes  no  direct  knowledge  cf  the 
present  Coast  Guard  Officer  Performance  Management  System 
nor  the  Officer  Fitness  Reporting  System  which  it  replaced. 
Likewise,  it  assumes  that  the  reader  will  have  little  or  no 
direct  knowldege  of  the  history,  evolution,  nor  research  and 
development  which  preceded  the  implementation  of  the  OP  MS . 
Therefore,  a  historical  review  will  follow  this  section  . 

The  remaining  chapters  of  the  thesis  will  address  design  and 
implementation  of  appraisal  systems  in  general, and  the  meth¬ 
odology,  results  and  analysis  of  the  survey  instrument 
designed  to  assess  current  acceptance  levels  for  the  OPMS  by 
the  Coast  Guard  cfficer  corps. 


B.  BACKGROUND  AND  LITERATURE  REVIEW 

The  Coast  Guard  has  long  used  a  method  of  narrative  and 
numerical  evaluations  for  the  purposes  of  officer  personnel 
management.  These  reports  on  the  fitness  of  an  officer  were 
prepared  semi-annually.  They  formed  the  core  of  an  officer's 
personal  file.  This  file  was  then  used  to  determine  the 
suitability  of  each  officer  for  promotion,  assignment,  and 
schooling.  Linking  this  reporting  system  to  promotion  and 
assignment  greatly  magnified  the  impact  cf  the  evaluation 
process  on  the  individual  officer. 

Before  proceeding  further,  it  is  necessary  to  view  the 
development  of  personnel  appraisal  in  the  Coast  Guard  in  a 
historical  contest. 

1 .  First  Re  torts  in  Mi  lita rv 

The  year  1890  is  generally  considered  as  the  initial 
establishment  of  a  formal  reporting  system  in  the  military, 
this  stemming  from  efforts  in  the  U.S.  Army  tc  develop  a 
system  for  reporting  the  relative  worth  of  Army  officers 
within  the  service.  This  resulted  from  social  pressures  cf 
the  day.  The  influence  of  the  "scientific  management  commu¬ 
nity"  and  Taylorism  was  growing  as  a  social  force. 
Additionally,  it  was  at  this  time  that  the  historical 
billeting  and  posting  practices  of  the  Army  gave  way  to  the 
needs  of  qlobal  expansionism  of  U.S.  influence.  Officers  who 
had  once  been  posted  at  the  same  regiment  as  many  relatives 
were  formed  into  new  regiments  as  the  Army  grew  and  the 
structure  changed  [Ref.  1]. 

The  first  efforts  at  evaluating  U.S.  military  offi¬ 
cers  predates  this  system,  however,  to  the  Continental  Army 
in  re vclut icnary  times.  The  most  widely  known  examples  of 
early  reports  ar*  those  emanating  from  Brig.  General  Lewis 
Cass  in  1813,  as  related  by  Dilvcrth  [Ref.  2], 
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2.  First  as cor  ds  of  PA  in  Coast  Guard 

There  ar«  few  records  of  the  former  services  which 
combined  to  fora  the  present  day  entity  of  the  service  which 
suggest  that  any  performance  appraisal  was  conducted  in  the 
earliest  years  of  its  existence.  During  the  revolutionary 
period  through  1900,  promotion  in  the  officer  ranks  was 
accomplished  priaarily  as  a  function  of  seniority  and  other 
less  specific  dictums  of  the  period.  However,  with  the 
advent  of  the  principles  of  "scientific  management"  and  the 
r:.se  in  influence  of  Taylorism,  all  O.S.  Military  organiza¬ 
tions  experienced  an  increased  exposure  tc  performance 
appraisal  systems. 

The  O.S.  Lifesaving  Service  was  combined  with  the 
O.S.  Revenue  Marine  (formerly  the  Revenue  Cutter  Service)  in 
1915  by  an  act  of  the  O.S.  Congress  which  created  the  O.S. 
Coast  Guard.  For  the  first  time  in  the  service's  history,  a 
formal  system  of  records  was  created  to  effect  promotion 
within  the  newly  created  organization. 

During  both  Morld  Wars,  the  Coast  Guard  operated  as 
an  adjunct  to  the  O.S.  Navy.  As  such,  Navy  fitness  reporting 
procedures,  policies  ,  and  forms  were  adopted  by  the 
service.  This  was  done  essentially  as  an  administrative 
convenience  to  the  Navy.  Thus,  much  of  the  organizational 
legend  regarding  fitness  reporting,  appraisal,  and  promotion 
policy  are  direct  descendants  of  the  Navy  policy  for  that 
period.  Officers  were  promoted  solely  on  a  fully  qualified 
basis,  did  not  compete  within  their  pay  grade  for  promotion, 
and  were  promoted  only  when  (a)  service  needs  allowed,  and 
(b)  they  were  fully  qualified  for  the  next  higher  grade  as 
depicted  by  their  file  of  fitness  reports  [Sef.  3], 

Even  though  the  Coast  Guard  was  recognized  as  a 
separate  military  and  armed  uniform  service  in  19«9,  a  long 
delay  since  we  fought  alongside  and  as  part  of  the  0.3.  Navy 


in  all  wars  since  the  American  Revolution  ,  the  service 
maintained  many  Fast  Navy  promotion  policies  through  the 
1950's.  However,  with  the  passage  of  the  Kerrins-Stephens 
legislation  in  1?64,  the  United  States  Coast  Guard  finally 
adopted  service  epecific  officer  promotion  and  appraisal 
system. 

3.  Best  Qualified  Promotion 

The  officer  promotion  system  was  changed  to  reflect 
the  impacts  of  the  Kerrins-Stephens  legislation  in  1964.  A 
new  form  of  fitness  report  was  designed  by  Mr.  Joseph 
Ccllir.s  and  implemented  by  the  service.  Promotions  were  then 
made  cr.  the  basis  of  a  best  qualified  as  described  by  the 
new  report  forms.  Promotion  became  competitive  within  the 
ranks  as  promotion  zones  defined  the  number  of  officers 
eligible  for  con  -ideration,  yet  permitted  less  than  all  of 
the  zone  to  be  promoted.  Additionally,  the  legislation 
required  a  pyramidal  billet  structure  for  the  service, 
implemented  the  policy  of  "  up  or  out"  which  today  charac¬ 
terizes  military  careers. 

The  Coast  Guard  Officer  Fitness  Reporting  System 
remained  stolid,  with  few  revisions  and  without  major  change 
until  1  January  1982.  At  this  point  it  was  summarily 
replaced  vitn  the  Officer  Performance  Management  System 
(OP MS ) .  The  factors  which  caused  the  change  are  subject  to 
debate.  The  Coast  Guard  Officer  Fitness  Reporting  System 
may  have  been  outmoded,  inflated,  unwieldy,  not  psychometri- 
cally  sound,  or  cot  liked  from  its  inception  to  its  demise. 
These  factors  may  have  led  to  efforts  to  upgrade  the  system 
over  time. The  publishing  and  subsequent  adoption  of  the 
GUIDELINES  of  the  1978  Equal  Employment  Opportunity 
Commission  by  the  federal  bureaucracy  may  well  have  hastened 
this  process. 
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•  Dynamics  fog  Change 

These  changes  in  the  rules  for  performance  appraisal 
were  among  many  that  led  then  Commandant  of  the  Coast  Guard, 
Admiral  John  B.  Hayes,  to  direct  the  establishment  of  a 
staff  element  to  study  the  system  and  provide  recommend 
change  for  the  future.  This  led  to  the  contracting  of  the 
General  Research  Corporation,  McClsan,  Va.,  as  an  external 
research  agency  to  assist  in  the  development  of  a  replace¬ 
ment  for  the  then  current  Officer  Fitness  Reporting  System. 
The  GRC  effort  began  in  March  of  1980. 

Coast  Guard  Commander  Nicholas  H.  Alien  and  Mr. 
Bradford  P.  Sharp  headed  this  research  effort  for  the  Coast 
Guard;  Mr.  Daniel  J.  Tcbin,  Dennis  G  Faust,  Ph.  D. ,  and 
Robin  Lovely  were  key  researchers  fer  GRC  [Ref.  4:  ch.  1  ]. 

C.  GENERAL  RESEARCH  CORPORATION 

The  General  Research  Corporation,  Final  Report  to  the 
Coast  Guard,  March  1981,  was  issued  three  months  subsequent 
to  the  decision  to  implement  the  OPMS.  The  report  provided 
specific  conclusions  relevant  to  the  development  of  a  proto¬ 
type  officer  performance  appraisal  system  and  the 
organizational  context  and  environment  to  be  encountered  by 
that  system.  The  conclusions  are  pertinent  to  the  state  of 
the  art  at  that  time,  the  effectiveness  of  implementation, 
ar.d  the  long  tern  effectiveness  of  any  performance  appraisal 
system  adopted  bj  the  service  for  the  officer  corps. 

1 •  General  Fesearch  Corporation  Final  Report 

The  report  of  the  GRC  to  the  Coast  Guard  identified  clearly 
that  there  were  dysfunctions  in  the  fitness  reporting 
process.  Additionally,  General  Research  Corporation  recora- 
ended  specific  clanges  to  t h9  process  of  officer  personnel 
management  in  the  Ccast  Guard  .  General  Research  Corporation 


cast  the  tenor  of  its  analysis  within  the  framework  of  the 
organizational  context  of  the  Coast  Guard.  This  final  report 
to  the  service  cites  several  perceptions  which  will  impact 
on  general  systens  effectiveness  of  any  perfromance 
appraisal  efforts  directed  at  the  Coast  Guard  officer  corps 
in  general  [Bef.  4:ch.4-6, ]. 

2.  GRC  Svst fa  Conclusions 

The  study  groups  conclusions  are  listed  below: 


r 


1.  The  currert  svstem  has  been  adequate  in  the  past 
and  possesses  varying  degrees  of  loyalty  and  acceo- 
tance  from  the  leadership,  officer  corps,  and  system 
users. 

2.  The  current  fitness  resorting  system  does  not  take 
advantage  of  state-of  the-art  advances,  nor  does  it 
meet  the  sugcested  design  features  of  the  Uniform 
Guidelines  ( EEOC  GUIDELINES  197  8)  . 


rap 


4.  Because  the  current  svstem  is  essentially  an  event 
oriented  rather  than  a  Frocess-oriented  system,  it  is 
inadequate  ir  terms  of  improving  performance  through 
effective  counseling  and  is  vague  in  its  relationship 
to  actual  performance  requirements  and  standards. 

5.  The  currert  system  is  narrow  in  its  orientation  in 
that  it  assicns  a  single  powerful  role  to  the 
reporting  officers  to  the  detriment  of  the  roles  that 
other  members  of  the  evaluation  chain  should  be 
playinq. 

6.  There  is  little  or  no  training  in  regard  to  evalua¬ 
tion  traininc  and  resoo nsibilities  in  rhe  current 
system 

7.  The  Coast  Guard  officer  corps  is  becoming  progres¬ 
sively  more  qualified. 

8.  The  fitness  reporting  system  for  the  1980's  will  be 
under  greater  scrutiny  Doth  internally  and  externally. 
Therefore,  it  is  increasingly  likely  that  the  system 
will  be  required  to  show  that  it  adequately  performs 
its  intended  functions  and  conforms  to  the  uniform 
Guidelines. 
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9.  The  fitness  reporting  system  for  the  1980‘s  must  be 
an  open,  n  above  board  system  prepared  to  meet  the 
challenges  ard  achieve  the  support  and  confidence  of 
the  officer  corps. 


10.  The  fitness  reporting  system  fer  the  1580’s  needs 
to  better  accomodate  the  performance  improvement  func¬ 
tion  and  better  assist  the  organization  in  the 
management  of  its  work  effort. 


11.  The  fitness  reporting  system  for  the  1980‘s  should 
be  expanded  from  an  event-oriented  system  to  a  more 
dynamic  performance  cycle  orientation. 


12.  The  above  may  reguire  more  performance  appraisal 
training  for  all  Coast  Guard  officers. 


3.  GRC  Syst  tm  Secommen dations 


Following  the  field  testing  of  a  prototype  form  a 
associated  process  intended  to  replace  the  then  current 
Officer  Fitness  Fepreting  System,  GHC  issued  the  following 
recommendations  to  the  Headquarters  Staff  and  Study  Grcep 

[Bef.  U:ch. 4 ]. 


In  general  it  is  recommended  that  : 


The  revisions  to  the  existing  system  follow  the  forms 
and  procedures  ued  in  the  prototype  evaluation. 

Reccanizing  the  limitations  of  the  field  research 
activity,  that  all  policies,  procedures,  and  forms  be 
peverified  ir.  a  major  operational  field  test  prior  to 
implementation. 


A  comprehensive  set  of  separate  instructions  be  devel¬ 
oped  to  support  officer  fitness  reporting.  These 
instructions  be  contained  in  a  separate  manual  rather 
than  in  chapter  form  in  the  Personnel  Manual.  These 
instructions  should  contain  a  per formancestandards 
section  if  significant  data  are  available  from  the 
Coast.  Guard  job  task  analysis  prolect. 


A  strong, trailing  program  ip  perfgrmgmce  apparaisal  be 
developed  and  institutionalized  within  the  Coast 
Guard.  Determination  of  the  type,  quantity,  and 
desired  level  of  training  to  carry  out  fitness 
reporting  requirements  should  be  an  objective  of  the 
operational  field  test. 


A  comprehensive  informa tign  program  be  developed  for 
the  officer  corps  explaining  the  negd  for  and  purposes 
of  tae  fitness  reporting  system  revisions. 
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A  comprehensive  system  for  monitoring  the  plan  be 
developed.  It  is  not  expected  that  any  performance 
appraisa}  system  Mill  remain  effective  if  not  continu¬ 
ally  monitored. 


D.  CCAST  GUARD  1RANSITI0N  TO  OPUS 
1.  OP MS,  MBC,  and  A£a£  OER 

The  development  of  the  Coast  Guard  OPMS  is  not  a 
direct  result  of  the  General  Research  Corporation  findings. 
Forms,  procedures,  and  policies  were  revised  to  reflect  seme 
of  the  recommendations  of  these  external  consultants. 
Additionally,  the  internal  study  group  established  a  perfor¬ 
mance  apppraisal  system  which  also  included  internal  design 
parameters  not  necessarily  knevn  to  General  Research 
Corporation.  The  result  is  a  system  that  incorporates  not 
only  features  of  the  GRC  prototype,  but  also  contains  many 
parallel  forms,  policies,  and  procedures  of  the  U.S.  Army's 
Officer  Evaluation  Reporting  System  which  was  finalized  in 
1979  [Ref.  5].  The  close  resemblance  cf  the  Coast  Guard 
forms  and  processes  to  the  U.S.  Army  sysxem  may  stem  from 
GRC's  close  association  with  the  development  o~f  the  Army 
program.  It  remains  to  be  seen  whether  the  two  systems  will 
tear  close  resemtlence  in  the  future. 

To  describe  the  two  systems  as  parallel  is  appro¬ 
priate.  The  major  differences,  perhaps  the  only  differences, 
in  the  systems  are  the  inclusion  of  behaviorally  anchored 
rating  scales  (BARS)  by  the  Coast  Guard  and  the  semi-annual 
versus  annual  Coast  Guard  reporting  requirements.  Although 
this  is  a  rather  global  comparison  of  the  two  systems,  it  is 
adequate  for  the  purpose  of  this  study.  Both  systems  are 
essentially  MBO,  process-oriented  officer  performance 
management  systens.  Both  systems  use  an  appraisal  support 
form  and  a  performance  reprot  form.  The  intermediate 
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purposes  and  end  uses  of  each  system  are  the  same.  This 
comparison  has  been  drawn  to  enable  future  researchers  tc 
utilize  the  similarities  to  combine  data  bases  as  may  be 
appropriate. 

2.  Overview  of  OPUS 

Essentially,  OPMS  is  composed  of  a  cyclic  appraisal 
and  evaluation  process  which  is  guided  by  the  mandatory 
compilation  of  data  and  -journal  type  log  keeping.  As  a 
system  which  includes  goal  and  objective  setting  as  a 
process  for  developmnet  of  individual  potential  and  the 
integration  of  personal  and  organizational  goals,  the  Coast 
Guard  Officer  Performance  Management  System  is  a  classical 
application  of  Diucker's  management  by  objectives  [Ref.  6]. 

3.  Purpose  cf  OPMS 

The  purposes  of  the  OPMS  are  threefold  as  described 
by  U.S.  Coast  Guard  Instructions  [Ref.  7].  Appropriate 
sections  of  text  are  set  forth  below. 


Purpose.  The  Coast  Guard  Officer  Performance 
Management  System  (OPMS)  serves  three  main  purposes  in 
that  it: 

1.  Provides . relevant ,  credible  information  necessary 
for  maxing  important  management  decisions  primarily  in 
the  areas  of  promotion,  and  to  a  certain  extent, 
assignment. 

2.  Fosters  the. development  and  improved  performance  of 
individual  officers, and  thu,  the  quality  of  the 
officer  corps,  through  its  requrieraents  for  effective 
performance  counseling. 

3.  Enhances  crganizational  effectiveness  by  a  means  of 
structure .for  more  cleanly  assigning  responsibilities 
and  defining  relationships  between  people  and  tasks 
within  the  chain  of  command  . 


20 


4 


1.  OEMS  is  a  r  integral  part  of  managing  the  organiza¬ 
tion... 

2.  OEMS  is  c cntiruous. .  . 

3.  OEMS  measures  correct  and  relevant  dimensions  of 

performance.  .. 

4.  OPMS  limits  subjectivity... 

5.  OEMS  is  constructive... 

6.  OPMS  fosters  consistency... 

These  principles,  simply  stated,  form  the  basis  of 
extensive  organizational  policy  concerning  the  uses,  appli¬ 
cations  and  execution  of  the  data  generated  for  the  OPMS.  A 
mere  detailed  review  of  these  principles  is  available  in  the 
Coast  Guard  Instructions  which  implemented  and  govern  OPUS 
[Ref.  7% 

5-  Roles .  Functions .  Forms,  and  Process 

Addtionally,  the  implementing  instructions  estab¬ 
lished  roles  and  functions  of  officer  within  the  governance 
of  the  OPMS.  These  include  defined  roles  of 
Commanding  Officer 
Reported  on  Officer 
Supervisor 
Hepcrtinc  Officer 
Reviewer 

District  Personnel 
Commandant  (G-PO) 
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Each  of  the  roles  identified  has  specifically 
enumerated  tasks  and  responsibilities.  The  authority  defined 
by  the  instructicns  are  essentially  top  down.  It  is  of 
interest,  however,  that  the  responsibilities  for  reporting 
are  ,  at  least  iritially,  from  the  bottom  up.  It  is  the  duty 
of  the  Beported  cn  Officer  (K00)  to  initiate  reports,  seek 
assistance,  and  develop  his  performance.  [Hef.  7], 

There  are  three  forms  integral  to  the  OPUS. 
Generally,  these  forms  are  used  to  document  performance, 
report  performance  and  assess  future  potential  of  the 
reported  on  officer  (BOO).  These  forms  are  defined  as 
follows : 


mance  counseling,  and  performance  reporting. 

Officer  Perf  crmance  Report  (OPR)  .  The  report  used  by 
0W5  -Q  report  on  rhe  performance  and  potential  of  an 
officer. 

Officer  Performance  Beoort  Continuation  Fora.  The 
norm  usea“fo  present  a3drfionaT“c5m melts  and  evalua¬ 
tions  that  co  nor  fin  in  the  space  allotted  on  the 
OPS  . 


The  articulation  of  roles,  forms,  and  rime  frames 
are  provided  in  the  form  of  a  flow  chart  in  the  Commandant's 
Instructions.  At  the  risk  of  oversimplification,  it  is 
enough  tc  state  that  the  DSF  is  the  central  document  of  the 
MBO  process.  Supervisors  and  reported  cn  officers  develop 
this  document  at  the  onset  of  any  reporting  period  (semi¬ 
annually)  and  center  a  dialogue  on  its  contents.  This  fcrm 
is  periodically  reviewed  and  revised  during  the  reporting 
period.  At  the  completion  cf  the  period,  this  form  is  used 
in  support  of  developing  the  OPB.  The  OPE  is  forwarded  via 
the  chair,  of  comnand  to  Coast  Guard  Headquarters  where  it 
forms  the  core  of  the  officer's  personnel  file.  This  form 


may  be  used  in  the  basic  functions  of  promotion,  assi jnner.t, 
and  selection  for  training  cr  special  assignments.  It  is  a 
powerful  document.  [Ref.  7  ]. 

It  is  an  intent  cf  the  OPMS,  however,  that  process 
of  developing  these  forms  be  stressed  more  than  the  impact 
of  the  forms  themselves.  The  goal-setting,  feedback,  and 
counseling  feat ures--essent ially  the  people  process  MBO 
functions  of  the  Officer  Performance  Management  System--  are 
what  distinguish  it  from  the  Officer  Fitness  Reporting 
System  it  replaced. 

E.  SUMMARY 

This  concludes  the  introductory  section  of  this  study. 
The  reader  should  now  be  prepared  to  delve  into  broad 
industry  issues  cf  design  and  implementation  in  the 
following  chapter.  From  this  point,  the  author  will  develop 
an  awareness  of  design  criteria,  an  evaluation  process,  and 
the  results  of  a  survey  developed  and  administered  in  an 
attempt  to  fulfill  the  evaluation  requirements  in  part. 


II.  PERFORM A KCE  APP5 AIS  AL  DESIGN  AND  IMPLEMENTATION 

A.  INTRODOCTION 


"  Many  times. ..I  have  come  to  realize 
that  a  fervent  speech,  or  a  painstakingly 
well  written  document,  may  be  worth  no 
more  than  the  good  will  and  patient  coop¬ 
eration  of  these  who  say  thev  subscribe 
no  it.  The  multi pii carton  of  documents, 
resolutions,  exhortations,  and  declama¬ 
tory  statements  seems  to  be  the  major 
growth  business  of  the  age.  I  fear  we  too 
often  lay  more  stress  words  than  on  the 
stark  necessity  of  deeds  to  back  them 
up.. ." 

D.  D.  Eisenhower 


These  words  from  D.D.  Eisenhower  succinctly  point  out 
the  major  hurdle  encountered  by  those  who  would  make  policy 
today  3  ]«  It  may  be  all  toe  simple  to  voice  support 

of  a  policy  and  ccncuurently  vow  silently  to  let  it  wither 
on  the  vine  rather  than  oppose  that  policy  in  public. 
Likewise,  even  those  who  truly  support  policy  are  often  hard 
tasked  tc  transform  their  intents  into  consistent  action  in 
support  of  that  policy.  Thus,  it  is  vital  at  the  cutset  of 
an  en deavor ,such  as  changing  major  personnel  policy,  to 
ensure  that  the  policy  is  well  supported,  well  understood, 
and  readily  supportable  by  the  organization  for  which 
des  igr.ed. 

B.  STEPPING  STONES  IN  PA  DESIGN 
1 •  Examine  the  Givens 

It  is  likely  that  that  few  organizations  are  in  the 
position  of  designing  a  formal  appraisal  system  for  the 
first  time.  Mor €  likely,  organizations  are  apt  to  revise  an 
existing  system  to  meet  changing  times,  new  personnel  and 
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changed  work  spe cif ications .  How  prevalent  these  revisions 
can  be  was  revealed  in  a  study  of  major  corporations. 

Teel's  results  i rdicate  that  the  overwhelming  majority  cf 
systems  are  modified  every  three  to  five  years. 

Additionally,  his  study  indicates  that  minor  revision  and 
evolutionary  charge  is  more  prevalent  than  major,  revolu¬ 
tionary  change  ir  this  area  [Ref.  21]. 

Thus,  before  an  organization  launches  a  major  effort, 
to  redesign  an  operating  PA  system,  it  is  important  to 
examine  what  is  alredy  in  place,  ie:-  to  examine  the  givens. 
Some  leading  guesticns  put  forth  by  DeVries  (et  al)  are: 

1.  What  problems  or  issues  have  created  the  need  for 
redesign? 

2.  What  existing  organizational  com  mittmer.4-  is  there 
for  redesign? 

3.  What  can  raaiistical ly  be  done  during  a  specified 
time  period? 

u.  What  reso trees  exist  tc  carry  out  the  work? 

5.  How  important  is  it  to  design  or  revise  the  formal 
PA  system? 

It  is  hichiy  likely  that  the  process  of  PA  design 
and  revision  is  rever  ending,  a  Sysisphear.  task.  Even  those 
systems  that  are  working  well  today  will  unaoubtly  require 
change  in  the  future,  near  or  distant,  as  the  factors  which 
determine  the  jots  evaluated  will  undoubtedly  change.  Thus 
it  is  necessary  to  ask  and  re-ask  the  feregeing,  even  at  a 
time  when  the  design  or  revision  has  just  beer  implemented. 

2.  Choosing  the  Devslo  pment  Group 

Currently,  industry  trends  indicate  that  many  PA 
systems  are  designed  by  the  company's  corporate-level 
personnel  departxent.  A  1977  study  by  Lazer  and  Wikstrom 
indicates  approximately  73-  755?  of  new  PA  systems  grow  from 


corporate  staffs,  about  7-15?  grow  from  division-level 
staffs,  and  internal  or  external  consultants  account  for  the 
remainder. 

There  are  three  general  groups  who  could  participate 
in  the  design  stage  namely,  (1)  outside  counsultants ,  (2) 
inside  consultants  or  change  agents,  and  (3)  line  managers 
and  employees.  There  are  advantages  and  disadvantages  in 
directing  that  ary  ere  of  these  groups  conduct  the  design  of 
a  system  without  external  influence. 

Outside  consultants  who  are  specialists  in  PA  will 
likely  have  the  technical  expertise  to  provide  a  psychcme- 
trically  sound  P A  system.  Hcwever,  their  lack  of  inside 
knowledge  will  limit  their  awareness  of  the  nuances  of 
organizational  ccntext,  and  thus,  will  limit  their  ability 
tc  intergrate  the  PA  system  with  preexisting  organization 
systems.  Additio rally ,  the  cost  of  their  services  neces¬ 
sarily  dictates  that  the  association  of  an  organization  with 
external  agents  is  cf  the  short  term.  This  factor  may 
induce  many  shortfalls  of  insight  not  readily  obvious  to  the 
cursory  observer. 

Cn  the  other  hand,  internal  human  resource  special¬ 
ists  may  have  great  insight  to  the  structure,  legend  and 
operating  context  of  their  organiacion  .  Yet  their  product 
may  be  limited  by  a  paucity  of  indepth,  state-cf-the-  art 
knowledge  of  current  PA  technology.  Additionally,  internal 
change  agents  ma}  often  find  themselves  without  the  support 
structure  necessary  to  effect  legitimate  change.  They  may  in 
fact  lack  credibility  within  their  own  organization  simply 
because  they  are  part  of  that  organization  and  not 
outsiders!  Finally,  the  authority  of  infernal  consultants 
is  sometimes  limited  by  internal  organizational  politics. 

In  contrast  to  either  of  the  foregoing  groups  is  the 
final  group,  line  managers  and  employees.  Whereas  this  group 
may  be  lacking  technical  expertise  with  the  myriad 


ir.nervor  kings  of  a  PA  system,  they  do  have  the  most  expert 
knowledge  of  the  day  to  day  uses  of  work  at  hand  and  the 
evaluation  systen  in  place.  They  are  in  a  unique  position  to 
provide  the  most  realistic  and  accurate  input  concerning  the 
nature  of  the  work,  performance  criteria,  and  useable 
appraisal  methods. 

3.  A  Combination  of  Talents 

The  rational  approach  in  resolving  the  issue  of  who 
can  provide  the  test  information  in  design  a  a  new  system  is 
to  include  elements  of  each  of  the  f or ementicned  groups  at 
the  outset  of  the  design  process.  Each  group  is  able  to  to 
make  unique  contributions  tc  the  process.  Finally,  it  is 
critical  that  this  design  group  be  representative  of  the 
major  segments  of  the  organization  and  have  the  creaiblixy 
and  authority  necessay  to  win  the  acceptance  of  their  design 
by  top  management  as  well  as  lower  echslcr.  members  of  the 
organization  [Ref.  10]. 

4.  Evaluate  the  Organizational  Context 

The  organizational  context  into  which  PA  systems 
must  be  integrated  tc  be  effective  have  recently  been 
addressed.  Kane  and  Lawler  [Ref.  11],  and  Wexley  [Ref.  12], 
describe  factors  which  must  be  synthesized  when  imple¬ 
menting  new  systems  into  an  environment.  That  a  PA  system 
must  interface  with  many  systems  already  in  place  as  well  as 
future  changes  xc  these  systems  is  a  foregone  conclusion. 
Many  factors  resultant  from  these  areas  of  interplay  must  be 
acknowledged,  accounted  for  and  dealt  wixh.  Failure  to 
recognize  and  adcress  these  factors  from  the  design  stage 
can  severely  limit  the  success  of  any  PA  program. 


27 


5.  Consist  e  rcy  with  Ma  naqeaent  Philosophy  and  Practice 

Performarcs  appraisal  programs  do  rot  exist  in  a 
void.  Rather,  thty  terd  to  be  central  to  many  related  manag¬ 
erial  functions.  Generally,  they  are  existant  in  the  middle 
of  highly  structured,  hierarchical  organizational  processes. 
In  such  hierarchical  organizations,  it  is  likely  that 
responsibility  fcr  strategic  decisions  belongs  to  the 
senior  management.  likewise,  performance  appraisal  functions 
generally  belong  to  the  senior  member  of  a  manager-employee 
pair  [Ref.  10].  This  is  certainly  so  in  military  organiza¬ 
tions.  In  the  Co  cst  Guard  context,  many  regualtions  have 
been  produced  to  assure  that  the  appraiser  is  senior  to  the 
appraisee  in  the  past.  Thus  any  new  appraisal  system  must 
take  this  organisational  proclivity  into  account  from  the 
design  stage  .  Failure  to  dc  so  might  be  to  invite  added 
resistance  to  an  unneeded  change. 

When  organizations  with  a  strong  hierarchical  struc¬ 
ture,  typified  by  the  military,  enter  into  PA  programs 
involving  mutual  goal  setting,  sharing,  and  two-way  communi¬ 
cation,  dysfunctional  oehavior  can  be  a  result.  The  factor 
responsible  for  the  dysfunction  is  the  inconsistency  between 
the  FA  rcles  (of  openness,  sharing,  and  mutual  ownership  of 
strategic  goals)  and  the  general  operating  procedures  of 
following  orders. 

The  degrce  of  democracy,  delegation, and  openness 
implicitly  required  in  affective  particpative  PA  approaches 
may  render  a  performance  appraisal  system  meaningless  in  a 
traditionally  stiong,  top-down  organization  such  as  military 
unit  [Ref.  10:p.  99]. 

Thus,  it  is  critical  at  the  outset  cf  PA  design  to 
ensure  that  the  design  is  consistent  with  management  philo¬ 
sophy  and  practice. 


6.  Conflict  with  the  Nature  of  Mangerial  Work 

Efforts  by  Minrzberg  [Bef.  13],  McCall  [Ref.  14], 
and  Bennis  [Bef.  15],  to  observe  and  characterize  the  nature 
of  managerial  work  have  been  enlightening.  These  studies 
reveal  that  the  manager's  j  cb  most  often  consists  cf  brief, 
varied,  fragmented  activities.  Additionally,  it  has  been 
shown  that  managers  prefer  to  deal  with  current  issues  and 
non-routine  tasks.  Mint zbe rg ' s  study  went  on  to  charac¬ 
terize  most  of  managers'  action  as  ad  hoc,  reactionary 
rather  than  planted. 

Performance  appraisal,  on  the  other  hand,  requires  a 
process  characterized  by  relatively  long,  intense,  and 
concentrated  activity  focusing  on  past  performance.  The 
general  format  fcr  PA  tends  to  be  one  cf  high  structure  and 
periodic  routine.  Appraisal  frequently  requires  planned, 
formal  interactions  between  manager  and  employee  in  which 
interruptions  are  not  allowed. 

This  is  certainly  the  case  with  appraisal  techniques 
within  the  Coast  Guard.  Policy  makers  have  continually 
stressed  that  good  leaders  counsel  in  private.  Legal  actions 
have  required  formality  to  grew  to  immense  proportions  when 
negative  behaviors  are  deno ted.  Reports  of  fitness  cf  offi¬ 
cers  for  qeneral  and  specific  duties  are  closely  held,  not 
revealed,  and  subject  to  great  censure  if  misdistr ibuted. 

Therefore,  it  becomes  more  obvious  that  designers 
must  be  sensitive  to  the  nature  of  managerial  work  when 
designing  an  appraisal  system  .  Failure  to  account  for  the 
nature  cf  the  beast  may  place  the  system  in  direcr  conflict 
with  the  very  people  mosr  needed  to  make  it  work. 


7.  Cornelian ce  with  Lggal  Reguiregent a 

Federal  regulations  regarding  equal  eaploymert 
opportunity,  adverse  impact,  and  equity  have  grown  with  the 
adoption  of  the  1978  Equal  Employment  Opportunity  Commission 
Guidelines  [Ref.  16].  Additionally,  employee  litigation  has 
increasingly  enjoined  management  in  suit  tc  assure  fairness 
in  appraisal.  During  the  next  decades,  regulation  of 
appraisal  functions  is  most  likely  to  increase  rather  than 
decrease. 

8 .  Admin  1st  ration  c f  Performance  Appraisal 

The  source  cf  policy  and  procedure  regarding  perfor¬ 
mance  appraisal  are  important  cues  to  its  organizational 
impact.  There  are  several  echelons  where  theses  may 
emenate-for  exam  fie,  from  central  corporate  headquarters, 
regional  offices,  cr  local  line  management.  Each  source  iay 
a  differing  impact  cr  the  appraisal  system.  Not  only  do 
directives  carry  different  connotations  dependent  upon  their 
source,  but  they  may  imply  totaly  different  positions  of 
power  and  authority.  Thus, the  efficacy  of  policy  may  be 
dependent  upon  the  political  or  bureaucratic  position  cf  the 
source  of  the  policy.  This  point  is  best  described  in 
Allison's  analysis  of  the  "Cuban  Missile  Crisis"  [Ref.  17]. 

Additionally,  the  uses  of  performance  appraisal  vary 
from  office  to  office,  level  to  corporate  level.  Por 
example,  a  line  manager  may  use  appraisal  tc  encourage, 
reward,  or  dismiss  an  employee.  Performance  appraisal  in  the 
field  may  well  be  aimed  at  growth  and  development  of  the 
employee.  At  the  corporate  level,  however,  performance 
appraisal  may  take  on  the  appearance  of  being  soley  an 
administrative  function. 
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Performar.ee  appraisal  systems  with  employee  growth 
and  development  as  their  objective  are  best  operated  from 
positions  close  to  operating  units,  rather  than  from  corpo¬ 
rate  headquarters.  The  primary  concern  with  administrative 
functions  of  appraisal  tends  to  overshadow  the  developmental 
function  cf  systems  housed  in  a  central  corporate 

headquarters  ^Ref.  IQ ;  ch.  eQ  . 

Thus,  it  is  critical  that  designers  plan  for  -.his 
bias  when  designing  and  implementing  appraisal  systems  which 
nominally  ccncerr  themselves  with  growtn  and  development  of 
the  employees. 

9.  Integra  t  ion  with  other  Human  Resource  Programs 

Appraisal  is  often  a  stated  basis,  cr  core,  of  an 
organization's  human  resource  development  program.  Often 
other  programs  such  as  pay,  advancement,  retention,  and 
training  opportunities  are  keyed  to  an  appraisal  system,  at 
least  on  paper. 

In  reality,  however,  managers  are  often  unable  to 
use  FA  as  the  basis  for  rewards  or  punishments,  due  a  lack 
of,  or  overabundance  of,  rewards.  At  times  there  may  be  far 
too  few  rewards  for  anyone  to  share.  Conversely,  in  times  of 
growth  and  expansion,  everybody  shares  the  wealth  regardless 
of  personal  merit. 

Even  in  corporations  that  emphasize  merit-based  pay 
systems,  appraisal  is  often  not  integrated  as  a  system  to 
determine  merit.  Though  on  paper  the  system  might  appear  as 
the  functional  link  to  merit  pay  increases,  it  is  often 
subverted  to  meet  other  needs  of  management.  Teel  £Ref.  9], 
reveals  that  many  managers  have  forced  appraisal  ratings  to 
fit  salary  decisions  in  an  effort  to  provide  equity  or  avoid 
on  the  job  conflict. 


Contrastingly,  some  organizations  treat  other 
huaan  resource  programs  (such  as  salary,  promotion,  and 
selection  prograis)  as  totally  separate  from  the  appraisal 
process.  This  is  certainly  to  in  the  Coast  Guard  where  line 
officers  are  admonished  that  "  it  is  not  your  duty  to  deter¬ 
mine  prcmotabiii ty  when  evaluating  an  officer's  performance" 
and  where  pay  decisions  are  left  largely  to  Congress  and  the 
Secretary  of  the  Department  of  Transportation.  Thus,  an 
appraisal  system  may  appear  as  a  redundancy  in  organizations 
wherein  the  basic  functions  of  appraisal  are  usurped  by 
other  systems. 

DeVries  [Ref.  10:p.  101],  warns  "that  if  a  PA 
program  is  redundant  with  another  human  resource  program,  or 
if  its  timinq  restricts  its  usefulnasss  for  ether  personnel 
decisions  it  will  be  treated  superficially  or  forced  into 
inappropriate  uses  to  preserve  other  programs". 

10.  Top  Management  Sup  port 

Michael  leer  [Ref.  18]  cites  lack  cf  top  management 
support  as  a  critical  factor  that  is  cited  for  many  inci¬ 
dences  cf  failure  with  appraisal  systems.  "Top  Management” 
is  a  fairly  loose  term.  In  an  effort  to  more  closely  iden¬ 
tify  what  is  meant  ,  DeVries  [Ref.  10:p..  102],  lists  the 
following  factors  to  clarify  what  this  construct  infers: 

1.  Failure  to  place  major  responsibility  for  PA  imple¬ 
mentation  where  the  program  can  be  effectively  carried 
out . 

2.  Failure  to  allocate  the  resource?  necessary  to 
effectively  implement  PA  (money,  time,  staff). 

3.  Failure  tc  consider  how  PA  must  fit  with  other 
human  resource  programs. 

4.  Failure  tg  identify  a  clear,  organizational  policy 
consistent  with  operating  management  philosophy. 

5.  Failure  tc  include  effective  aopraisal  practices 
as  one  criterion  in  the  managerial  reward  structure. 


6.  Failure  tc  actively  monitor  PA  procedures  tc  and 

data  for  indicators  or  EEOC  compliance. 

An  additional  faczor,  often  enumerated,  is  the 
failure  to  provide  a  credible,  visible  sponsor  for  perfor¬ 
mance  appraisal.  Far  too  often,  top  executives  espouse  the 
importance  of  performance  apparaisal  for  others  and  disre¬ 
gard  it  themselves. 

C.  DESIGH  SOBMAEY 

Planners,  designers,  and  architects  of  human  nature  as 
well  as  physical  construct! ons  realize  that  any  major 
constructive  effort  will  stand  only  so  well  as  its  base  will 
support  it.  Thus,  it  is  vital  that  the  initial  analysis  and 
design  be  systematic,  global,  and  aimed  at  reducing  system 
generated  hazards  that  would  impact  on  the  users.  It  would 
be  best  if  everyone  were  to  gain  from  the  implementation  of 
a  new  appraisal  system;  as  a  minimum,  one  would,  assume  that 
the  design  would  ensure  that  nc  one  would  be  worse  off  as  a 
result  of  this  event. 

D.  STEPPING  STOKES  TO  EFFECTIVE  IMPLEHENT  AT  ION 

Implementation  is  the  critical  stage  of  transforming  all 
the  hard  work  and  handiwork  of  the  design  stage  into  an 
effective  operating  system  that  accomplishes  the  intended 
task  within  the  limits  of  the  criteria  established  by  the 
design  concepts.  This  system  must  usually  be  integrated 
into  a  complex  maze  cf  value  systems  and  organizational 
procedures  that  can  be  overwhelming. 

This  task  usually  falls  to  the  infernal  consultant  or 
the  organization’s  personnel  staff.  Nystrom  [Hef.  19], 
depicts  seme  problems  associated  with  this  manuever. 
Personnel  staffs,  though  often  in  the  best  organizational  or 


administrative  seat  for  implementing  such  a  program,  may 
have  a  reputation  of  such  narrow  focus  or  limited  success 
within  the  organization  so  as  to  lack  the  requisite  credi¬ 
bility  tc  effectively  implement  a  new  appraisal  system. 
Down-the-line  employees  are  often  skeptical  of  the  motives 
of  internal  staff  members  who  may  have  a  large  stake  in,  or 
much  to  gain  frou,  an  organizational  change  of  this  nature. 
It  is  not  important  whether  this  skepticsia  stem  from  fact 
or  experience.  However,  it  is  vital  tc  recognize  this 
common  perception  and  concurrent  distrust  as  a  factor  which 
may  weaken  even  the  best  planned  implementation  effort. 

Additionally,  new  programs  even  when  highly  polished  and 
far  removed  from  internal  politics,  are  often  viewed  as 
simply  "  another  personnel  program  "  .  To  avoid  this 
jaundice,  as  it  were,  top  management  may  be  well  advised  to 
scrutinize  who,  exactly,  is  leading  the  effort  of  implemen¬ 
tation.  Ey  the  judicious  use  of  members  highly  respected  for 
their  leadership  qualities  and  credibility,  top  management 
might  avoid  limiting  the  effectiveness  of  a  new  appraisal 
program  from  its  point  of  inception.  Conversely,  top  manage¬ 
ment  may  only  bl-me  itself  if  it  chooses  to  overlook  this 
point  uccn  impieaent aticn,  only  to  find  they  have  spent  a 
lot  of  time  and  effort  on  an  appraisal  program  with  limited 
impact  and  effectiveness  because  it  is  perceived  as  "  just 
another  personnel  program  "  [Ref.  19]. 

1 •  Train in  a  Pr  ograms 

There  is  some  controversy  regarding  the  extent  of 
training  necessary  when  implementing  a  new  appraisal 
program.  One  guideline  might  be  to  measure  the  amount  of  " 
newness  "  in  the  program,  or  to  asses  the  amount  of  change 
or  effectiveness  which  the  design  intends  to  accomplish  from 
the  change  to  the  new  system.  One  might  conclude  that  there 
is  a  direct,  lineal  relationship  involved.  let,  two  recent 


survey  efforts  still  ref lac t  a  difference  of  opinion  on  the 
need  for  training.  Lazer  and  Wikstrom  [Eef.  20],  depict 
that  about  75%  of  industry  conducts  some  type  of  training 
upon  imple mentation.  However,  Locher  ard  Teel's  results 
point  to  only  about  a  25%  incidence  of  training  concurrent 
with  new  systems  [Ref.  9]. 

Regardless  of  what  the  incidence  or  extent  of 
initial  training  efforts  may  be,  these  initial  efforts  are 
just  that,  initial.  There  is  no  guarantee  •'■hat  personnel  , 
knowing  what  is  required  of  them,  will  be  either  able  or 
willing  to  provide  it.  This  is  the  function  of  training, 
education,  and  system  discipline.  Although  appraisal  skills 
required  are  a  functionof  the  type  of  system  in  use,  two 
widely  accepted  skill-sets  are  (a)  performance  measuemer.t  or 
rating  skills,  and  (b)  feedback  or  communication  skills.  A 
system  based  on  the  principles  of  management  by  objectives 
would  also  require  high  competency  in  goal  setting  process 
[Ref.  10]. 

Hew  these  skills  are  best  acquired  is  subject  to 
debate.  Argyris  would  assert  that  these  skills  are  learned 
by  doing  [Ref.  2  2].  Recent  studies  done  separately  by 
Ivancevich  [Ref.  23],  and  Latham  [Ref.  24],  indicate  that 
these  skills (per formance  measurement  and  communication 
skills)  are  best  acquired  through  practical  training  ana 
experience  as  is  often  available  in  a  school  or  laboratory 
situation.  Additionally,  rater  training  has  been  shown  to 
reduce  psychometric  errors  by  raters.  This  was  detailed  by 
Klimoski  [Eef.  25]  in  a  study  of  of  rater  errors  published 
in  1974.  It  should  be  noted  that  the  effect  cf  this  type  of 
training  is  short  lived.  Thus,  periodic  refresher  training 
is  necessary. 

Tinally,  there  is  evidence  to  suggest  that  employees 
can  benefit  from  training  programs  which  depict  how  to 
receive  performance  appraisal,  especially  in  participative 


programs  such  as  MBO-based  appraisal  systems.  Four  issues 
seem  relevant  in  this  regard.  First, these  programs  permit 
employees  to  participate  more  actively  in  their  own  PA  than 
they  did  without  them.  Second,  these  programs  provide  for  a 
cadre  of  monitors  who  may  well  be  willing  and  able  to  main¬ 
tain  the  integrity  cf  the  system  over  a  longer  time  period 
than  without  this  training.  Thirdly,  this  same  cadre  often 
may  advance  to  the  management  level  and  be  or  become 
appraisers  themselves.  Lastly,  most  personnel  who  give 
appraisals  to  others  also  receive  them  themselves;  thus,  the 
training  program  may  certainly  flow  full  circle  and  have 
wide  application  . 

Although  the  rationale  cf  providing  training  seems 
obvious,  this  training  is  often  not  accomplished  by  organi¬ 
zations  i  trple  men  ting  new  appraisal  systems.  This  fact  nay  be 
a  main  factor  in  the  failing  by  many  systems  to  meet  t.ieir 
stated  performance  appraisal  goals.  An  excellent  example  of 
this  point  is  provided  by  Beer  [Ref.  18],  where  he  reLates 
his  experience  at  implementing  an  MBO  program  at  the  Corning 
Glass  Works  in  1S77. 

2 .  Pilot  Te  sting  Programs 

Before  buying  a  new  car,  most  of  us  will  take  the 
time  to  drive  it  first.  The  same  logic  that  guides  us  in 
personal  expenditures  should  also  be  applied  to  the  expendi¬ 
ture  of  great  resource  (time,  effort,  and  money)  in  our 
professional  lives.  A  performance  appraisal  system  must  be 
tested  before  it  is  placed  into  the  organization  who  must 
from  that  day  forth  "  ride  "  on  it.  The  new  system  can  be 
validated,  modified,  and  standardized  in  a  testing  situation 
before  it  is  given  the  broadest  implementation. 

It  is  important  at  this  point  to  opt  for  success. 
Choose  a  test  bed  that  is  (a)  representative  of  the  whole 
organization,  and  (b)  likely  to  have  a  successful  test 
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experience.  If  the  event  is  successful,  then  those  who  under¬ 
went  the  experience  can  form  a  cadre  of  missionaries  who  can 
advocate  the  use  of  the  system  from  their  own  experiences. 
Since  this  group  may  well  become  advocates,  it  is  critical 
to  analyze  who  they  are  before  you  test  the  system  on  them. 
Likewise,  it  is  necessary  to  design  a  system  test,  or  proto¬ 
type,  that  is  highly  likely  to  be  successful  with  this 
group. 

For  example,  if  the  group  is  perceived  as  deviants 
within  the  organization,  the  appraisal  system  may  be 
severely  cripplec  by  their  association  with  it.  Conversely, 
if  the  test  group  is  composed  of  credible,  powerful  figures 
in  the  organization  and  they  become  advocates,  well,  then 
this  is  a  very  satisfactory  situation. 

In  a  military  organization,  this  letter  group  is 
usually  known  as  the  top  management,  the  leaders,  the  policy 
makers,  cr  the  senior  officers.  They  have  the  authority  tc 
make  or  break  any  policy  or  procedure.  It  is  vital  to  have 
this  group  cn  board  with  a  successful  effort  from  the  begin¬ 
ning.  Successful  change  strategy  in  military  organizations 
is  from  the  top  down,  not  vice-versa. 

3.  Saint ena nee  Functions  Necessary  for  Successful  PA 

Kany  new  programs  have  not  survived  due  mainly  to 
lack  of  nurture  following  implementation.  Interventions  when 
necessary,  .re  most  successful  when  the  strategist  observes 
some  ongoing  continuum  for  change.  A  simple  model  for  change 
is  the  Kolb-Frohian  model  for  intervention  [Ref.  26]. 
Sssentially,  this  calls  for  an  ongoing  strategy  for  change 
which  dees  not  er.d  at  implementation.  Likewise,  implementa¬ 
tion  of  a  new  performance  appraisal  system  should  not  end  at 
day  one,  but  rather  continue  throughout  the  life  of  that 
system  within  the  organization. 
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Maintenance  functions  which  continually  encourage 
the  use  of  the  syetm  may  spell  the  difference  between 
success  and  failure.  The  organization  must  provide  a  reward 
structure  that  encourages  managers  to  use  the  system  in  the 
fashion  designed  [Ref.  27],  Additional  functions  that  may 
keep  the  syetm  rolling  on  the  paths  to  effectiveness  includ 
reminder  services,  continued  training  and  consultation  with 
human  resource  p zof essional s,  and  actions  by  top  management 
in  consonance  with  the  system  principles  spell  the  minimum 
level  of  support  requisite  for  success. 

4.  Evaluat ion  of  Effectiveness 

The  objective  evaluation  cf  system  effectiveness  is 
often  the  most  o omitted  stage  of  the  implementation  process 
It  is  a  critical  issue,  knowing  that  the  system  is  func¬ 
tioning  as  intended  and  accomplishing  the  -“-asks  required, 
yet  it  is  net  accomplished  in  many  instances.  Reasons  for 
this  are  varied.  Often,  it  is  easy  to  assume  there  is  littl 
value  in  knowing  whether  the  system  is  functioning  properly 
unless  it  can  be  linked  directly  with  production  or  profit. 
At  times,  those  who  are  responsible  for  directly  advocating 
or  implementing  a  new  system  may  block  objectives  analysis 
as  a  resultant  of  the  personal  impacts  that  the  analysis 
might  have.  Evaluation  of  performance  appraisal  system  can 
indeed  be  risky  ventures  at  least. 

As  a  continuation  of  the  stepping  stone  approach  sc 
far  presented,  the  following  questions  are  posed  as  appro¬ 
priate  probes  for  the  evaluation  process. 

1.  Was  the  system  installed  as  designed? 

2.  Are  the  e aployees  using  the  system  as  it  was 
designed  to  te  used? 

3.  Are  the  systems  intended  Durposes  and  outcomes 
being  accomp  ished? 
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4.  Dees  the  terfcraance  appraisal  system  fit  within 
the  organizational  context,  particularly  in  terms  of 
other  human  resource  programs? 

There  are  various  types  of  changes  which  can  be 
instituted  along  the  way.  Essentially,  each  negative  answer 
to  the  preceding  questions  would  lead  back  to  the  design  and 
implementation  stages.  A  simplistic  management  control 
system  that  asks  these  questions  does  not  need  to  meet  the 
parametric  requirements  of  classical  research,  rather  it 
need  only  collect  data  relevant  to  the  intended  tasks  and 
design  of  the  system. 


Z.  CONCLUSION 

1.  This  discussion  may  have  painted  a  monstruous  spectre 
fer  performance  appraisal,  not  unlike  that  of  a  small  craft 
at  sea,  caught  ir.  an  ocean  storm,  expending  its  total  energy 
in  simply  keeping  afloat,  with  r.c  prospect  of  ever  reaching 
the  shore.  let  the  effort  must  clearly  be  made;  appraisals, 
r.c  matter  how  subjective  or  system-deficient  must  be  made, 
and  data-based  systems  to  manage  the  information  thus 
complied  must  be  used. 

Despite  the  contrcverse y ,  two  guidelines  may  appear 
worth  following.  First,  performance  appraisal  must  be 
understandable  to  these  who  use  if,  regardless  of  type, 
content,  procedure  or  purpose.  If  it  is  not  clearly  articu¬ 
lated  and  understood,  then  the  system  holds  r.o  chance  of 
being  effective  within  the  context  of  its  original  purpose. 
Secondly,  perforsance  appraisal  must  make  sense  in  relation 
to  other  business  systems.  Although  affective  appraisal  is 
rarely  a  cure,  ireffective  appraisal  is  often  a  symptom  of 
ineffective  management.  Thus,  rather  than  adding  to  the 
organizational  dysfunction,  it  should  contribute  to  the  well 
being  of  the  institution  upon  which  it  has  been  implemented 
£  He f .  10:ch.  6 ]. 
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In  summary,  the  implementation  of  a  personnel  appraisal 
system  requires  that  the  employees  have  (a)  at  least  or.e 
good  reason  to  try  it,  (b)  adequate  competencies  to  use  it 
effectively,  and  (c)  a  way  to  make  it  part  of  their  ongoing 
jobs  rather  than  a  peripheral  duty. 

Additionally,  there  must  be  a  positive  reward  system 
within  the  organizational  culture  to  encourage  the  effectiv 


III.  METHODOLOGY 


A.  INTRODUCTION 

The  met  hodol  cgy  cf  the  study  consisted  of  developing  a 
tarqet  sample  for  the  survey,  a  target  for  the  results  of 
data  collection  effort,  developing  a  survey  instrument  that 
was  relevant  in  terms  of  the  targets,  administering  the 
survey  instrument,  and  finally,  interpreting  fire  wnat  the 
data  depict  in  formats  that  are  relevant  to  the  target 
audience  (s)  . 

B.  RELIABILITY  1ND  VALIDITY 

Two  extremely  important  properties  that  all  in  strumer.ts 
should  possess  are  reliability  and  validity.  Reliability 
reflects  the  degree  to  which  the  results  of  the  measurement 
are  free  from  error,  that  is,  attributable  to  systematic 
sources  cf  variance  {Ref.  28].  Validity  reflects  the 
degree  tc  which  a  measure  actually  measures  what  it  purport 
to  measure  [Ref.  29:p.  75], 

1  *  Reliabil  itv 

Reliability  cf  measures  refers  most  to  the  repeat¬ 
ability  of  the  measure,  that  the  results  can  be  duplicated 
within  ncrmal  Units  by  additional  performances  of  the 
measure.  For  exaaple,  geographical  surveying  techniques  are 
classified  according  to  their  inherent  ability  to  measure 
the  same  geophysical  dimensions  with  repeated  accuracy,  in 
ether  words,  according  to  the  reliability  of  the  technique. 
This  is  analogous  to  the  issue  of  reliabili*"'  in  the  psycho 
metric  sense  as  »ell. 
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Three  gereral  methods  of  ensuring  reliability  cf 
psychometric  measures  are  (a)  test  and  re-test,  (b)  equiva¬ 
lent  form  testing,  and  (c)  split-half  testing.  The  survey  of 
the  Coast  Guard  officer  corps  included  equivalent  forms  or 
the  same  guesticr  in  an  effort  to  measure  the  reliabilty  of 
the  survey  instrument. 

A  measure  of  the  reliability  of  the  survey  may  be 
developed  by  exauining  the  correlation  bewteen  these  forms 
in  a  representative  sample  cf  officers. 

2 .  Validity 

The  validity  cf  measures  generally  is  discussed  in 
terms  of  one  cr  nore  of  the  following  types:  (a)  content, 

(b)  construct,  (c)  criterion-related,  (d)  face,  (e)  incre¬ 
mental,  (f)  convergent  and  discriminant , and  (g)  synthetic 
validity.  Conten*  validity  deals  with  the  ability  of  the 
measure  to  cover  the  range  cr  domain  of  the  subject  matter 
ir.  question.  Construct  validity  deals  with  the  ability  to 
measure  abstract,  variables  such  as  thought  processes  or 
intelligence.  Criterion  related  validity  involves  the  power 
cf  the  measure  as  a  predictor  of  some  other  attribute,  for 
making  inferences  relative  to  issues  not  measured  directly. 
Face  validity  is  exactly  that:  a  measure  that  appears,  at 
least  superficially,  to  measure  what  it  purports  to  measure. 
Incremental  validity  refers  to  the  ability  to  measure 
"somewhat  better"  than  ether  tools  already  available.  A  new 
test  or  procedure  would  probably  need  incremental  validity- 
before  researchers  would  adept  it  over  some  method  already 
in  use.  Convergent  cr  divergent  validity  refers  tc  the 
extent  that  measures  are  assessed  on  their  ability  to 
confirm  the  results  already  shown  by  other  methods.  For 
example,  a  test  nay  have  convergent  validity  when  the 
measured  values  converge  on  values  demonstrated  by  another 
test  known  to  tbs  valid.  Finally,  there  is  synthetic  or 
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job-component  validity.  This  final  measure  is  relevant  when 
developing  tests  to  measure  job  skills.  A  measure  would 
have  synthetic  validity  for  a  skin  diver  if  it  involved 
separate  valid  measures  of  different  skin-diving  skills 

[Hef.  30:ch.  4 ]. 

C.  SELECTING  THE  SAMPLE 

Three  basic  requirements  needed  to  be  met  by  the  sample 
First,  the  sample  had  to  be  from  all  career  fields  of  the 
Coast  Guard.  Hopefully,  a  representative  sample  would 
enhance  the  logic  of  extrapolating  the  results  to  the  whole 
population  sampled  .  The  cell  size  of  the  sample  areas 
selected  should  be  large  enough  to  provide  statistical 
significance  to  the  inferences  made  from  the  results  and 
enahr.ce  the  reliability  of  the  statistics  developed  from  th 
sample.  Finally,  to  be  free  from  regional  biases,  the 
sample  should  be  drawn  from  all  geographic  areas  of  assign¬ 
ment  for  Coast  Guard  off icers  £  Ref.  30:ch.  6]. 

D.  INSTRUMENTATION 

1 .  General  Ce velopment 

The  survey  instrument  was  developed  in  a  classic 
manner  as  described  best  by  Payne  [Ref.  31].  Most  basi¬ 
cally,  a  review  cf  the  present  literature  on  the  subjects 
related  to  personnel  appraisal  led  to  a  superficial  under¬ 
standing  of  the  ceneral  issues.  Then,  through  a  process  cf 
personal  interviews,  telephone  debates,  and  observation  in 
seminars  related  to  the  issues,  the  framework  for  ques¬ 
tioning  became  clear.  Using  questionnaires  developed  for 
the  pilot  testing  program,  incorporating  issues  that  were 
identified  by  the  General  Research  Corporation  in  the  devel 
cpmental  stages  cf  OEMS  [Bef.  4:ch.  3]  and  including  the 


results  of  much  interview  time,  the  author  was  able  to 
synthesize  the  line  of  questioning  into  a  group  of  questions 
that  appeared  contextually  acceptable. 

Central  to  this  effort  were  the  works  of  Payne 
fBaf.  31]  and  the  Fcrx  Hood  Questionaire  Construction  Manual 
[Ref.  32],  These  two  resources  were  invaluable  in  the 
process  of  developing  the  survey  instrument.  Each  of  these 
resources  is  rich  in  logic  and  further  reference.  These  two 
sources  should  net  be  overlooked  by  those  who  are  in  the 
business  of  survey  development. 

2.  Pat  a  Collection 

Upon  receipt  of  the  surveys,  the  raw  data  were  coded 
and  entered  into  an  SPSS  data  file.  These  daJ  a  are  entirely 
numerical. 

Some  subjectivity  exists  in  the  data  coding  .  The 
best  and  worst  features  of  the  OPMS,  as  solicited  by  ques¬ 
tions  R 2  and  R3,  were  segregated  into  two  categories.  This 
appeared  rational  at  the  beginning  of  the  coding  effort. 
Later,  it  became  apparent  that  this  data  could  be  better 
represented  if  ceded  into  five  categories. 

3 •  Content  analysis 

Analysis  of  the  comments  is  essentially  left  undone 
and  really  demands  attention.  As  a  minimal  level  of 
analysis,  all  of  the  comment  pages  have  been  photostaticaliy 
reproduced  and  forwarded  no  the  Headquarters  Analysis  Group 
for  their  review. 

Additionally,  selected  remarks  will  be  used  in  the 
reporting  of  results  to  demonstrate  the  meaning  of  the 
numbers,  where  appropriate.  The  remarks  wiM.  also  be  used  to 
depict  the  wide  range  of  controversy  surrounding  the 
isssues.  Finally,  an  appendix  containing  representative 
remarks  is  included  in  this  study. 
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These  efforts,  however,  do  not  do  justice  to  the 
great  amount  of  effort  made  by  the  respondents  to  accurately 
and  frankly  identify  their  positions  concerning  the  OPMS.  It 
is  the  sincere  hcpe  of  the  author  that  the  net  effect  of  the 
remarks  is  not  insignificant. 

4.  Caveats  of  Analysis 

The  interpretation  cf  data  is  always  a  subjective 
function.  There  is  mere  a  question  of  what  degree  cf 
subjectivity  exists  rather  than  one  of  its  very  existence.  A 
major  source  of  this  subjectivity  can  be  demonstrated  by 
viewing  the  organizational  context  in  which  decisions  are 
made.  Considering  the  three  major  models  of  organizational 
decision  making,  that  is  the  rational,  bureaucratic,  and 
political  models,  one  can  demonstrate  that  the  same  data  set 
nay  receive  entirely  opposite  analysis  as  a  result  of  the 
organizational  context  of  analysis.  This  dichotomy  is  a 
result  cf  the  basic  assumptions  of  the  models  and  the 
differing  processes  cf  analysis.  Significant  determinants  of 
data  interpretation  are  (a)  type  of  organization  conducting 
the  analysis,  (b )  position  of  analyst  in  that  organization, 
(c)  stakeholder  ( s)  in  that  organization  relative  the  conclu¬ 
sions  of  analysis,  and  (d)  whether  the  data  support  or 
threaten  the  position  of  the  organization  or  the  analyst. 
Thus,  the  tenor  cf  the  analysis  may  largely  be  dependent 
upon  where  you  sit  at  the  time  cf  analysis  [Hef.  17], 

Additionally,  the  numerical  differences  in  the  data 
and  the  nuances  cf  interpretation  are  seldom  as  simple  as 
the/  seem.  Hather,  they  tend  to  stem  from  profound  differ¬ 
ence  in  approaches  to  complex  problems.  Issues  of  this  type 
are  seldom  resolved  when  reduced  to  mere  arithmetic  rela¬ 
tionships,  because  the  differences  lie  in  the  mind  of  the 
analyst. 
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Finally,  though  the  differences  in  interpretation 
may  be  philosophically  great,  they  often  stem  from  minor 
differences  in  numbers.  A  few  hundredths  of  a  percentage 
point  may  spell  the  difference  between  success  ana  failure 
for  seme  adversaries.  Yet,  the  magnitude  of  the  difference 
may  seem  lilliputian  at  best. 

Thus  one  might  readily  accede  to  the  multiple  reali¬ 
ties  inherent  in  the  analysis  of  data  by  keeping  these 
simple  maxims  it  mind: 

1.  11  It  depends..."-  on  ycur  point  of  view,  or. 
your  stake  in  the  game,  on  your  belief  in  the 
power  of  the  data,  atcetra... 

2.  "It's  not  that  simple..."-  other  factors  are 
involved,  the  data  is  r.ct  representative,  the  test 
is  net  reliable,  etcetera... 

3.  "  The  differences  are  net  that  great. ..  "-even 
thouah  they  may  be  irr econciliaole ,  etcetara... 

Nonetheless,  the  opinion  of  researchers  may  vary 
greatly,  and  vehement  discussion  often  emirates  from  adamant 
stands  on  subtle  differences  which  are  not  readily  discer¬ 
nible  by  the  cursory  examination  of  the  data.  This  may  well 
be  the  case  with  the  data  collected  here;  however,  it  is 
essential  that  an  effort  is  made  to  analyze  these  results. 

B.  SAMPLE  DEHOGFAPHICS 

The  sample  consisted  of  five  hundred  active  duty  Coast 
Guard  Officers.  The  demographic  breakdown  of  this  sample  is 
shown  through  the  SPSS  CROSSTABS  feature.  The  CROSSTABS  are 
included  in  this  section.  [Ref.  33]. 
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Breakdow  r.  Grade 


The  sample  includes  paygrades  01  Through  06,  Ensign 
through  Captain.  The  mailing  of  surveys  included  500  offi¬ 
cers  of  these  grades  who  were  stationed  throughout  the 
geographic  domain  of  Coast  Guard  billets.  Additionally,  this 
mailing  included  all  accepted  career  fields  for  Coast  Guard 
officers.  The  analysis  of  responses  that  follows  will  be 
predicated  on  the  grade  of  the  respondents.  Thus,  it  is 
appropriate  at  this  point  to  demonstrate  the  representati ve 
nature  of  the  saapie.  The  percentages  for  the  SAMPLE  RESULTS 
are  as  measured  by  the  survey.  The  percentages  for  the 
ACTUAL  POPULATION  are  as  legislated  by  Congress.  These  are 
listed  in  [Ref.  34].  The  legislated  percentage  of  01's  and 
02*  s  is  combined  as  35.25^. 

The  freguency  distributions  are  shown  as  Table  I. 

2 .  Breakdow  r  by  Career 

Eight  major  career  fields  were  utilized  to  select 
the  officers  to  te  polled.  The  sample  distribution  by 
carreer  field  is  shown  as  Table  II. 

3 .  Breakdow  r  by  Duty  A  ssiur.ment 

Additionally,  the  demographic  analysis  provides  the 
ability  to  breakdown  the  respondents  by  the  category  of  duty 
assignment.  Nine  major  levels  of  assignment  were  included 
in  the  data  gathered.  The  sample  distribution  by  duty 
assignment  is  shewn  as  Table  III. 

u .  Breakdown  by  Boles  and  Effects 

Two  additional  features  were  measured  by  the  demo¬ 
graphic  data  collected.  The  role(s)  of  the  respondents 
within  the  0PMS,  and  the  number  of  officers  effected  by  the 
respondents  throegh  these  roles. 
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Officer  Distribution  by  Grade 


SAMPLE  RESULTS  ACTUAL  POPULATION 


REL 

REL 

ABSOLUTE 

FREQ 

FREQ 

CATEGORY  LABEL 
CAPTAIN 

FRi$ 

(PCT) 

7.5 

•EU 

COMMANDER 

22 

8.3 

12.00 

LCDR 

86 

32.5 

18.00 

LIEUTENANT 

62 

23.4 

28.00 

LT  JUNIOR  GRADE 

64 

24.2 

35.25 

ENSIGN 

10 

3.8 

- 

NO  RESPONSE 

1 

0.4 

- 

TOTAL 

265 

100.0 

GRADE 

CODE 

I 

1.  ***********  (  20) 

I  CAPTAIN 
I 

2.  ************  /  22) 

I  COMMANDER 
I 

3.  *************  4********** ***********  *********  t 
I  LCDR 

I 

4.  ********************************  /  52) 

I  LIEUTENANT 
I 

5.  ************* ***********  *********  (  54) 

I  LT  JUNIOR  GRACE 
I 

6.  ******  (  1C) 

I  ENSIGN 
I 

I . I . I . I . I . I 

0  20  40  60  60  100 

FREQUENCY 

VALID  CASES  264  MISSING  CASES  1 


It  is  an  accurate  assumption  that  the  roles 
portrayed  are  sequential  and  hierarchical.  That  is,  that  if 
a  respondent  indicates  a  role  as  Reporting  Officer,  he  also 
fills  the  basic  functions  of  Reported  on  Officer  and 
Supervisor,  as  well.  Thus,  though  it  is  not  clearly  shown 
in  the  SPSS  breakdown  of  the  data,  each  supervisor  is  also  a 
reported  on  officer.  The  subordinate  roles  can  be  augmented 
by  the  reader  in  this  manner,  if  he  so  chooses. 


TABLE  II 

San  pie  Distribution  by  Career  Field 


CAREER  SPECIALTY 


RELATIVE 

ADJUSTED 

CUM 

ABSOLUTE 

FREQ 

FREQ 

FREQ 

CATEGORY  LABEL 
SURFACE  OPERATIONS 

FREg 

KV 

KV 

AVIATION 

47 

17.7 

17.7 

43.4 

ENGINEER 

50 

18.9 

18.9 

62.3 

MIO  MEP 

50 

18.9 

18.9 

81.  1 

MANPWR  PERS  TRNG 

21 

7.9 

7.9 

89.  1 

FINANCE  SUPPLY 

8 

3.0 

3.0 

92.  1 

LEGAL 

7 

2.6 

2.6 

94.7 

OTHER 

9 

3.  4 

3.4 

98.  1 

NO  RESPONSE 

5 

1.  9 

1.9 

100.0 

TOTAL  26  5 

103. 

0  100.0 

CAREER  SPECIALTY 

CODE 

I 

1.  ************************ ***********  /  5gv 

I  SURFACE  OPERA  HONS 
I 

2.  *************************  (  47} 

I  AVIATION 
I 

3  **************************  /  50) 

I  ENGINEER 
I 

4.  **************************  /  50) 

I  MIO  MSP 
I 

5.  ************  i  21) 

I  MANPWR  PERS  TFNG 
I 

6.  *****  (  8) 

I  FINANCE  SUPPLY 
I 

7.  *****  (  7) 

I  LEGAL 

I 

8.  ******  /  cj 

I  OTHER 

I 

9.  ***  (  5) 

I 

I . I . I . I . I . I 

0  20  40  60  80  100 

FREQUENCY 

VALID  CASES  265  MISSING  CASES  0 


The  final  demographics,  roles  in  OPMS,  number  of 
officers  supervised,  and  number  of  officers  supervised  and 
reported  on  are  shown  in  Tables  IV,  Table  V,  and  Table  vi  , 
respectively. 
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TABLE  III 

Distribution  by  Duty  Assignment 


RELATIVE 

ADJUSTED 

CUM 

ABSOLUTE 

FREQ 

FREQ 

FREQ 

CATEGORY  LABEL 
COMMANDING  OFFICER 

FR|$ 

P 

A3’ 

JEP 

EXECUTIVE  OFFICE F 

19 

7.2 

7.2 

17.7 

OPERATIONS  OFFICER 

4 

1.5 

1.5 

19.2 

DIFOPS 

7 

2.6 

2.6 

21.9 

DIVISION  CHIEF 

18 

6.8 

6.8 

28.7 

ERANCH  CHIEF 

24 

9.  1 

9.1 

37.7 

DEPUTY  .'RANCH  CHIEF 

22 

8.3 

8.3 

46.0 

OTHER 

30 

11.3 

11.3 

57.4 

NO  RESPG.SE 

113 

42.6 

42.6 

100.0 

TOTAL 

265 

100.0 

100.0 

DUTY  ASSIGNMENT 

CODE 

I 

1.  ********  (  28) 

I  COMMANDING  OFFICES 

T 

2.  ******  (  IS) 

I  EXECUTIVE  OFFICER 
I 

3.  »*  (  4) 

I  OPERATIONS  OFFICES 
I 

4.  ***  (  7) 

I  DIFOPS 

I 

5.  ******  /  IS) 

I  DIVISION  CHIEF 
I 

6.  *******  /  24) 

I  3RANCH  CHIEF 
I 

7.  *******  (  22) 

I  DEPUTY  BRANCH  CHIEF 
I 

8.  *********  (  30) 

I  OTHER 
I 

g,  *****************************  r  113) 

I  NO  RESPONSE 
I 

I . I . I . I . I . I 

0  40  80  120  160  200 


FREQUENCY 

VALID  CASES  265  MISSING  CASES  0 


TABLE  IV 

Distribution  by  OPUS  Holes 


RELATIVE 

ADJUSTED 

CUM 

ABSOLUTS 

FREQ 

FREQ 

FREQ 

CATEGORY  LABEL 

FREQ 

(PC  T) 

(PCT) 

(PCT 

REPORTED  ON  OFFICER 

1  27 

47.9 

47.9 

47.9 

SUPERVISING  OFFICER 

64 

24.2 

24.2 

72.  1 

REPORTING  OFFICER 

40 

15.  1 

15.  1 

87.2 

REVIEWING  OFFICER 

33 

12.5 

12.5 

99.6 

OTHER  ROLE 

1 

0.4 

0.4 

100.0 

TOTAL 

265 

100. c 

100.0 

PRESENT  BOLES  IN  OP MS 

CODE 

I 

*************  4* ** *******  **** ***** 

REPOSTED  ON  OIFICER 


1. 

I 

I 

2. 

I 

I 

3. 

I 

I 

4. 

I 

I 

5. 

I 

I 

0** 


***************** 

SUPERVISING  OEFIC 


Ell 


*********** 

REPORTING  OF 


I 


ICER 


40) 


****  ***** 

REVIEWING 


(  33) 

OFFICER 


* 

OT 


{IeR  ROll 


. I . I. 

40  80 

FREQUENCY 
VALID  CASES  265 


(  127) 


6  4) 


..I, 

120 


160 


.  .1 

200 


HISSING  CASES 


F.  SUMMARY 

These  tables  present  the  data  as  of  7  February  1993-  At 
this  point  in  tine,  265  responses  were  received  by  the 
author.  Additional,  responses  will  be  included  in  the 
historical  files  to  be  provided  to  the  Conunandant ,  U.S. 

Coast  Guard,  if  received.  However,  the  data  analysis  will 
proceed  from  this  point  predicated  on  265  cases. 

The  following  chapter  will  present  responses  to  signifi¬ 
cant  issues  pcsed  by  the  author's  survey  effort. 
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TABLE  V 


Distribution  by  Nuaber  Supervised 


R  ELATIVE 

ADJUSTED 

CUM 

fBSOLOTE 

FREQ 

FREQ 

FREQ 

CATEGORY  LA  EEL 

FREQ 

(PCT ) 

(PCT) 

(FCT) 

SUPEE0N  NONE 

130 

49.1 

49.2 

49.2 

SUP  ERON 1- 3 

83 

31.3 

31.4 

8  0.7 

SUPEEON4-6 

35 

13.2 

13.3 

93.9 

SUP  ERON7-9 

1  1 

4.2 

4.2 

98.  1 

SUP  ERON 10-12 

2 

0.8 

0.8 

98.9 

SUP  ERON 13-15 

1 

0.4 

0.4 

94.2 

SUPERON 1 6-18 

1 

0.4 

0.4 

99.6 

SUP  ERON 19-21 

1 

0.4 

0.4 

100.0 

NO  RESPONSE 

1 

0.4 

MISSING 

100. 0 

TOTAL 

265 

1  00.0 

100.0 

FILE  NONAME 

(CREATION 

DATS  = 

02/01/83) 

NUMBER  SUPERVISEE 

CODE 

I 

0,  **********************************  /  130) 

I  SUPERVISE  NOSE 
I 

1.  **********************  /  83) 

I  SUPERVISE  1-3 
I 

2.  **********  /  351 

I  SUPERVISE  4-6 
I 

3.  ****  (  11) 

I  SUPERVISE  7-9 
I 

4.  **  (  2) 

I  SUPERVISE  10-12 
I 
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I 
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I 
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Distribution  by  Number  Reported  On 


and  Supervised 


REL  ATIVE 

ADJUSTED 

CUM 

AESOLUTE 

FREQ 

FREQ 

FREQ 

CATEGORY  LABEL 
REPORT  NONE 

FREQ 

194 

-fSfi* 

1f:I> 

REPORT  1-  3 

27 

1  0.  2 

10.2 

83.  7 

REPORTU-6 

23 

8.7 

3.7 

92.4 

REPORT7- 9 

7 

2.6 

2.7 

95.  1 

REPORT10-12 

6 

2.3 

2.  3 

97.  3 

REPORT1  3-  15 

2 

0.8 

0.8 

98.  1 

REPORT  16-18 

1 

0.  4 

0.  4 

98.5 

REPORT22-24 

4 

1.5 

1.  5 

1C0.0 

NO  RESPONSE 

1 

0.4 

MISSING 

100.  0 

TOTAL 

26  5 

10  0.0 

103.  0 

NUMBER  REPORTED  CN 
CODE 
1 
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I  REPORT  NONE 
I 

1.  ********  (  27) 

I  REPORT1-3 
I 
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I  3EPORT4-6 
I 

3.  ***  (  7) 

I  REPORT7-9 
I 
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I  REPORT10-12 
I 

5.  **  (  2) 

I  REPORT  13-1 5 

6.  *  J  1) 

I  REPORT  16-18 

T 

8.  **  (  4) 

I  REPORT22-24 
I 

I . I . I . I . I . I 

0  40  80  120  160  200 

FREQUENCY 

VALID  CASES  264  MISSING  CASES  1 
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IV.  SURVEY  RESULTS 


A.  SURVEY  ANALYSIS 

The  author's  analysis  is  centered  on  issues  of  great 
concern.  If  the  OPMS  is  to  be  utilized  to  its  fullest 
potential,  then  it  must  be  accepted  by  the  officer  corps.  It 
is  unclear  at  this  point  what  the  exact  level  of  acceptance 
should  be  tc  spell  acceptance.  A  "  preponderance  "  of  the 
data  should  support  the  OPMS  if  it  is  to  be  concluded  that 
the  system  has  been  been  accepted. 

Khat  exactly  constitutes  a  preponderance  is  also 
unclear.  Surely,  if  the  data  are  ,say,  four-fo-one  in  one 
direction  or  the  other,  that  is  preponderance  in  the 
author's  mind.  Perhaps  even  a  two-to-one  ratio  is  "  prepon¬ 
derance  ".  Where  the  data  are  less  claar-cut  than  this,  the 
reader  will  have  to  decide  for  himself  whether  the  data  ara 
in  support  cf  or  contrary  to  the  OPMS. 

In  this  regard,  the  rapsonses  to  the  survey  questions 
have  been  categorized  in  two  classes  ,  "Agree"  and  "Do  not 
Agree  ".  Neutral  repsonsas  have  been  included  in  the  "Do 
not  Agree"  category.  This  has  teen  done  tc  sharply  demons¬ 
trate  the  dichotomy  of  the  response  sets  between  those  who 
did  clearly  state  their  agreement  with  the  statements  pcsed 
and  those  who  did  not  state  their  agreement  with  the  state¬ 
ments.  A  more  specific  breakdown  of  the  responses  is 
included  in  Appendix  A. 

1 .  Overall  Feaction  of  the  Officer  Corps 

The  overall  reaction  to  the  OPMS  was  measured  by  the 
first  statement  cf  the  survey,  R1.  This  element  is  quoted 
below.  The  response  to  this  question  is  shown  in  the 
following  summary.  Table  VII. 


R 1  "Considerinc  all  of  70 ur  experiences  so  far  with  the 
OPMS  process,  what  is  your  overall  reaction  to  the 
entire  System?" 


TABLE  VII 

Cverall  Reaction  to  the  OPMS 


HI 

Positive 

Not  Positive 

Capt 

40. OS 

60.  0« 

CDR 

3  1.8« 

68.  2% 

LCD  R 

39.6% 

60.  4% 

LT 

42.6% 

57.  4% 

LTJG 

57.8% 

42.  2% 

ENS 

6  0.0% 

40.  0% 

Distribution 

By  Total  Sample 

44.9% 

55.  1% 

The  response  zc  this  question  shows  that  the  officer 
cor  os  is  split  ir  its  reaction  the  the  OPMS.  The  best  means 
of  analyzing  these  results  may  be  in  terms  of  what  the 
expected  results  might  have  been.  If  the  reader  required  an 
overwhelming  statistic,  for  or  against,  to  support  an 
hypothesis,  then  these  results  clearly  do  not  support  the 
reader's  hypotheses.  In  the  author's  mind,  this  table  shows 
lukewarm  support  of  the  OPM S  in  general  terms,  not  on 
specific  issues. 

A  different  presentation  of  these  same  data  may 
allow  the  reader  to  draw  a  different  view  of  the  data.  An 
example  of  this  is  provided  in  Table  VIII, In  this  table,  a 
three  column  foraat  may  allow  the  reader  to  think  in 
specific  terms  concerning  those  who  do  not  support  the  OPMS 
with  their  positive  responses  on  the  survey.  This  presenta¬ 
tion  does  not  clarify  the  issues  in  the  mind  of  the  author. 
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Bather,  it  serves  to  cloud  the  response  dichotomy.  As  such. 


this  format 

will  not  be 

used  in  further 

analyses  and 

Cverall 

TABLE  VIII 

Reaction  to 

the 

OPMS 

HI 

Positive 

Ne  utral 

NO 

t  Positive 

Capt 

4  0.0% 

25.03 

35.53 

CDR 

3  1  .83 

4  0.93 

27.3% 

LCDR 

39.6% 

44.23 

16.23 

LT 

42.63 

34  .43 

23.07 

LTJG 

57  .87 

31.33 

10.97 

ENS 

60.07 

4  0.03 

00.  07 

Distrib 

By 

Tct  Sample 

44  .97 

3  6.93 

13.23 

provided  here  fcr  informational  purposes  only. 

These  sane  data  presented  in  a  differing  format 
still  permit  the  conclusion  that  only  44.97  of  the  respon¬ 
dents  would  voice  their  support  of  the  OPMS,  and  by  default 
that  the  remaining  sector  of  the  sample  would  not  voice 
their  support.  The  reader  will  find  the  frequency  of 
response  to  each  question  in  Appendix  A. 

2.  CPUS  is  Cnif crmlv  A  op lied  ? 

The  perceptions  of  the  officer  corps  concerning  the 
uniform  application  of  the  OPMS  were  gathered  through  the 
use  of  three  questions,  A9,  A 10,  All.  The  first  issue  is 
question  A9  which  is  quoted  below.  The  response  to  question 
A9  is  shown  in  Table  IX. 

A9  "The  OPMS  is  being  applied  uniformly  to  all  grades  of 
Coast  Guard  officers." 
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TABL2  IX 

OPflS  is  Applied  Uniformly  by  Grade  ? 


A9 

Agree 

Do 

not 

A 

Capt 

15.8% 

64. 

2% 

CDR 

18.2% 

31. 

8% 

LCD  R 

10.1% 

39. 

9% 

LT 

8.3% 

91. 

7% 

LTJG 

12.9% 

87. 

1% 

ENS 

2  2.2% 

77. 

3% 

Distr ibution 

By  Total 

Sample 

12.0% 

88. 

0% 

In  this 

instance,  t 

he 

dat 

a  do 

Q 

mistrust 

of  the 

application 

of 

rh 

a  OP 

MS 

the  effi 

cer  corp 

s  is  clearl 

y 

t  ha 

t  th 

3 

uniformly  to  all  grades  of  Coast  Guard  officers.  Efforts  to 
disprove  this  perception  may  well  be  necessary  for  corps¬ 
wide  acceptance  cf  the  0P!1S. 

Survey  element  A 10  is  quooed  below.  The  response  to 
this  elemen*  is  shewn  in  Table  X. 


A 10  "The  OPMS  is  bein< 
fields  for  Coast  Guarc 


applied  un: 
or  fleers. " 


iormly  in  all  career 


A  summarj  of  this  dimension  affirms  the  mistrusr 
revealed  in  question  A9.  To  the  author,  this  mistrust  is 
quite  alarminq  ! 

Survey  element  All  tests  this  issue  yet  another  way, 
by  duty  assignment. While  it  was  intended  that  this  question 
specifically  measure  attitude  as  a  function  of  geographic 
area  of  assignoert,  cr  district,  retrospective  analysis  of 
the  question  may  reveal  that  this  question  does  not  expli¬ 
citly  accomplish  this  task.  Thus,  the  analyses  is  left  in 


T  ABLE  X 

OPHS  is  Applied  Uniformly  by  Careers  ? 


A 10 

Agree 

Do  not  Agr 

Capt 

1  1.  155 

88.  9% 

CDR 

4.8% 

95.  2% 

LCDS 

6.7% 

93.  3% 

LT 

5.1% 

94.  9% 

LTJG 

15.9% 

84.  1% 

ENS 

o 

o 

• 

o 

b* 

100. 0% 

Distribution 

By  Total  Sample 

9.0% 

91.0% 

mere  general  terns.  This  survey  item  is  quoted  below;  the 
results  are  shown  in  Table  XI. 


All. "The  OP  MS  is  being  applied  uniformly  in  all  duty 
assignments  throughout  tae  Coast  Guard." 

Analysis  of  this  question  demonstrates  me  pervasive 
perception  that  the  OPMS  is  net  used  the  same  way  everywhere 
in  the  Coast  Guard,  r.or  in  every  career  field,  nor  is  it 
perceived  tc  be  applied  the  same  way  to  every  grade. 


3.  OPMS  is  Worth  the  Effort  ? 

The  attitudes  of  the  officer  corps  regarding  the 
relative  payback  of  the  OPMS  were  measured  using  questions 
A24 ,  A25,  and  A26.  The  responses  to  these  questions  are 
summarized  in  tabular  form. 
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TABLE  II 

0PH5  Applied  Uniformly  by  Assigns’t? 


All 

Agree 

Do  not  Agre 

Capt 

1 1.1% 

88.9% 

CDS 

00.055 

100.0% 

LCDS 

6.655 

93.4% 

LT 

00.0% 

100.  055 

LTJG 

CO 

• 

r- 

t— 

83.  2% 

ENS 

O 

• 

o 

o 

100. 0% 

Distribution 

3y  Total  Sample 

5.7 % 

94.  3% 

Question  A24  measures  the  attitude  regarding  the 
worth  of  the  effcrt  in  counseling  subordinates.  The 
responses  are  reported  in  Table  XII. 


A 24  "The  time  ana  effort  I  spend  on  documenting,  coun¬ 
seling,  and  feedback  with  my  juniors  are  worth  it." 

A  summarj  of  these  data  is  that  there  is  some 
ambiguity  in  the  perceptions  of  the  officer  corps  on  this 
issue.  Certainly,  the  response  to  rhe  question  does  not  shew 
that  the  officer  corps  clearly  percei/es  -hat  the  effcrt 
required  by  the  CPHS  by  seniors  towards  -heir  juniors  is 
"  worth  it  ".  This  indicates  lukewarm  commitment  no  rhis 
facet  of  the  OPKS  at  best. 

Question  A25  tests  this  issue  in  another  direction, 
towards  seniors.  The  question  is  quoted  here;  +he  results 
are  reported  in  Table  XIII. 


TABLE  XII 

Effort  Spent  on  Juniors  Worth  It? 


A  24 

Agree 

Capt 

47.4% 

CDR 

36.3% 

LCD  R 

59.3% 

LT 

36.5% 

LTJG 

26.7% 

ENS 

4  2.9% 

Distr  ibution 

By  Total  Sample 

43.5% 

A25  "The  time  and  effort 
seling,  and  feedback  with 


Do  not  Agree 
52.  6% 

63.1% 

40.7% 

63.  5% 

73.  3% 

57.  n 

56.5% 

spend  on  documenting.  coun- 
tny  superiors  are  worth  it." 


TABLE  XIII 

Effcrt  Spent  on  Seniors  worth  It? 


A  25 

Agree 

Do  not  Ag 

Capt 

26.4% 

73.  6% 

CDR 

27.2% 

72.  8% 

LCDR 

57.3% 

42.7% 

LT 

43.3% 

52.  1% 

LTJG 

70.3% 

29.  7% 

ENS 

50.0% 

o 

• 

o 

Distribution 

By  Total  Sample 

52.1% 

47.  9% 

A  summary  of  these  data  affirms  the  ambivalence  cf 
the  officer  corps,  this  concerning  whether  the  OPMS  process 
is  "  worth  it  "  «hen  working  with  seniors.  The  mixed  accep¬ 
tance  of  these  issues  may  indicate  a  lukewarm  commitment  to 
the  use  cf  these  processes  by  Coast  Ouard  officers,  espe¬ 
cially  the  senior  grades  of  Captain  and  Commander.  This  may 
undermine  the  entire  OPMS. 

Question  A26  measures  this  dimension  overall  by 
asking  whether  the  OPMS  pays  back  what  is  put  into  it.  The 
responses  are  shown  in  Tc.ble  XIV. 


A26  "In  general,  the  OPMS  pays  back  what  I  put  into  it." 


TABLE  XIT 

OPMS  has  a  Good  Payback  ? 


A  26 

Agcee 

Do  not  Agree 

Capt 

3  1.65 

68.  4% 

CDS 

22.7% 

77.  3% 

LCDR 

3  6.8% 

6  1.2% 

LT 

36.6% 

63.  4% 

LTJG 

57.  1% 

42.  9% 

ENS 

50.0% 

50.  0% 

Distribution 

By  Total  Sample 

4  1.3% 

58.7% 

These  responses  confirm  what  what  has  been  hinted  at 
in  the  preceedinc  two  guestions.  With  only  41.35  of  the 
entire  corps  perceive  a  valid  payback, the  OPMS  is  net  on 
strong  ground.  More  importantly,  the  senior  officers,  those 


61 


with  the  power  tc  make  or  break  a  policy  and  who  are  also  ir. 
the  key-use  roles  in  the  system,  are  decidedly  negative  on 
this  issue. 


4.  There  is  Time  for  A  n other  ?ricr :.ty  ? 

The  attitudes  of  the  officer  corps  concerning  prior¬ 
ities,  workload  and  additional  OEMS  priorities  was  measured 
using  questions  P 27,  A28,  and  A2S. 

Question  A27  concerns  on-the-job  time  available  for 
the  performance  cf  OEMS  duties.  The  results  are  ambivalent; 
they  are  shewn  ir  Table  XV. 


27  ”1  have  encugh  time  on  my  iob  to  Perform  my  0PM3 
uties." 


TABLE  X? 

There  is  Enough  Time  on  the  Job  ? 


A  27 


Agree 


Co  no*  Agree 


capt 

4  0.0$ 

6  0.0$ 

CDR 

27.3$ 

72.  7% 

LCDR 

40.7$ 

59.  3$ 

LT 

48.3$ 

fc< 

r- 

• 

in 

LTJG 

62.5$ 

37.5$ 

ENS 

60.0$ 

40.  0$ 

Distribution 

By  Total  Sample 

47.2$ 

52.  3$ 
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The  data  on  this  issue  are  ambivalent  when  viewed 


overall.  Once  again,  however,  04’s,  OS’s,  and  06’s  are 
decidedly  negative. 

Question  A28  seeks  response  to  another  issue, 
whether  OPMS  duties  hinder  the  performance  of  other  duties 
assigned  to  Coast  Guard  officers.  The  results  are  shown  in 
Table  XVI. 


A 28  nThe  performance  of  my  OPM$  duties  does  not.  hinder 
the  performance  of  my  other  primary  duties." 


TABLE  XVI 


OPMS 

Does  Not 

A  28 

Agree 

Capt 

60.0% 

CDR 

31.8% 

LCDR 

45.3% 

LT 

46.6% 

LTJG 

54.7% 

ENS 

70.0% 

Distribution 

By  Total  Sample 

48.8% 

Hinder  Primary  Duty  ? 

Do  not  Agree 

40.  OS 

68.2* 

54.  7% 

53.  4% 

45.3% 

30.  0* 

51.2% 


A  summers  of  this  table  indicates  that  tha  percep¬ 
tion  of  the  officer  corps  is  countar  to  the  hypothesis.  The 

response  to  A28  does  indicate  ambivalence  of  the  officers 
sampled  in  the  survey  process. 
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V. 


Question  A29  seeks  similar  information  in  another 
dimension,  whether  collateral  duties  are  hindered  by  the 
OPM S  duties.  The  responses  are  shown  in  Table  XVII. 


A29  "The  performance  of  mv  OPHS  duties  does  not  hinder 
the  performance  of  my  collateral  duties." 


TABLE  XVII 


OPMS 

Does  Not 

Hinder 

Collaterals 

A29 

Agree 

Do 

not  Agree 

Capt 

6  0.0% 

40.  0% 

CDH 

31.8% 

68.  2% 

LCDE 

38.9% 

61.1' 

LT 

41.6% 

53.  4% 

LTJG 

57.9% 

42.  U 

ENS 

60.0% 

40.0% 

Distribution 

By  Total  Sample 

46.0% 

54.  0% 

A  summary  analysis  of  this  response  again  indicate 
ambiguity.  Certainly,  the  officer  corps  is  not  strong  in 
support  of  this  issue.  This  issue  remains  as  an  area  of 
concern. 

5.  AM.  fail  for  I  mprovemer.t  ? 

Whether  cr  not  there  is  a  felt  need  for  change  is 
important  factor  in  instituting  any  change  in  an  organiza¬ 
tion.  The  strength  of  this  felt  need  was  measured  by 
questions  A35,  A26,  A37,  and  A38. 
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Survey  element  A35  questions  whether  the  supervisors 
are  performing  their  duties  as  perceived  by  the  officers 
reported  on.  The  results  are  shown  in  Table  XVIII. 


A35  "My  supervisor  is  performing  his  OPMS  duties  as 
required  by  the  regulations." 


TABLE  XVIII 


Supervisors 

Perform 

OPMS  Duty 

A  35 

Agree 

Do 

not  Agree 

Capt 

40.0% 

60.0% 

CDR 

45.4% 

54.6% 

LCDR 

43.  n 

56.  9% 

LT 

4  2.6% 

57.  4% 

LTJG 

57.8% 

42.  2% 

ENS 

60.0% 

40.  0% 

Distribution 

By  Total  Sample 

47.1% 

52.  9% 

These  data  definitely  indicate  a  problem  here.  When 
more  than  half  of  the  senior  officer  corps  indicates  that 
their  seniors  are  net  performing  their  OPMS  functions,  then 
a  red  flag  should  wave  in  the  face  of  the  analyst.  This 
type  of  nen-perf crmance  indicates  a  problem;  whether  the 
problem  lies  with  the  people  or  the  system  is  not  revealed 
the  data. 

Question  A36  suggests  that  no  improvements  are 
necessary  for  the  OPMS  evaluation  process.  The  officer  corps 
dees  net  support  this  suggestion.  The  results  are  shown  in 
Table  XIX. 


A  36 
an 


"No  impro v emnts  to  the  OPMS  are  necessary  to  Bake  i 
effective  tool  for  performance  evaluation." 


TABLE  XIX 


Nc 

Improvements 

for  OPHS  PE  ? 

A  36 

Agree 

Do  not  Agree 

Cap*. 

5.3% 

94.  7% 

CDS 

00.0% 

100.  0* 

LCD  3 

4.7% 

95.3% 

IT 

4.9% 

9  5.1% 

LTJG 

14.  1% 

85.  9% 

ENS 

10.0% 

90.0% 

Dis  tribution 

By  Total  Sample 

6.9% 

93.  1% 

An  analysis  of  these  data  indicates  an  overwhelming  felt 
need  for  improvement  in  the  performance  evaluation  process 
as  posed  by  question  A36. 

Question  A37  poses  the  same  issue,  but  refers  to  the 
promotion  and  selection  process.  The  response  to  this  is  is 
shown  in  Table  XX. 


"No  improvements  to  the  OfMS  are  negessarv  to  make  it  an 
effective  fool  for  selecting  qualified  officers  for 
promotion." 


A37 

The  response  indicates  overwhelming  dissatisfaction 
with  this  dimension  cf  the  OPMS .  This  is  definitely  an  area 
for  concern  regarding  the  organizational  context  or  "system 
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TABLE  XX 


No  Changes  to 

OPHS  /  Promotion 

A  37 

n 

<t> 

/r> 

Do  not  Agree 

Capt 

10.  if. 

39.5% 

CDS 

0  0.055 

100.  0% 

LCDS 

5.955 

94.  15£ 

LT 

4.9% 

95.  1% 

LTJG 

11.05b 

89. 0% 

2  NS 

10.055 

9  0.0% 

Distr ibut 

ion 

By  Total 

Sample  6.9% 

9  3.  1% 

fit"  of  the  OPUS  with  pre-existing  human  resource  programs. 
This  degree  of  felt  need  for  change  may  well  stand  in  the 
way  of  any  further  acceptance  of  this  system  by  the  officer 
corps. 

Survey  element  A33  rephrased  the  issue  and  ques¬ 
tions  the  felt  n*ei  fc::  immediate  improvements  in  the  OPhS 
selection  and  pr emotion  functions.  The  response  is  shown  in 
Table  XXI. 


A  38  "Immediate  improvemnts  to  the  OPMS  are  necessarv  to 
make  it  ar.  effective  tool  for  selecting  qualified  offi¬ 
cers  for  promotion." 

This  equivalent  form  of  the  preceeding  question 
confirms  the  felt  need  for  change  to  the  OPHS  along  the 
dimension  of  selection  and  promotion.  This  may  well  hinder 
the  acceptance  of  this  appraisal  function  of  the  OPhS. 
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TABLE  XXI 


C 

)  FMS  Improve 

sent 

s 

Nece 

ssary  ? 

A  38 

Agree 

Do 

not 

Agree 

Capt 

88.8% 

11. 

-)  <r 

i.  ■ 4 

CDS 

90.9% 

9. 

1% 

LCD  R 

84.7% 

15. 

3% 

LT 

83. 4S 

16. 

6% 

LTJG 

78.  It 

21. 

9<S 

2NS 

80.0% 

20. 

0% 

Distr 

ibut 

ion 

By  To 

t  ai 

Sample 

83.4% 

16. 

6 

6 

•  2 

JEMS  is 

Crqanizatio 

nail 

1 

--  7 

rn 

he  que^ 

stion  of  org 

aniz 

a  t 

ion  a 

1  fit  is 

vita 

1.  It  is 

absol 

utel 

Y  necessary  that,  a 

per 

rman 

oe  appra 

isal 

system  be 

perce 

ived 

as  "right  for  the 

org 

an 

izat 

:.cn"  for 

that 

system  t 

succeed. 

A  meas 

sure  of  the 

?.tti 

tu 

ies 

of  Coast 

Guard  officer. 

conce 

rnina  this 

dimension  w 

as  g 

at 

1  using 

quest 

ions  A39, 

A40  , 

and 

A4  1. 

Q 

uestion  A39  tests 

the 

over al 

1  perception 

of  "right 

fit  " 

for 

the  OP ss  and  coun 

seli 

r.g 

/  de 

velop  men 

t ,  an 

d  supervi 

sory 

func 

tions. 

The  respons 

es  o 

r. 

this 

issue  a 

re  sh 

own  in 

Table  XXII. 


A39  "As  an  organization,  we  are  doing  the  right  thing  by 
using  this  system  (OPJ1S)  for  development  and  supervi¬ 
sion.  " 
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TABLE  XXII 

OP  MS  Pits  Supervision  /  Growth  ? 


A39  Agree  Do  net  Agree 


Capt 

60. O'? 

40. Of 

CDS 

45.4°$ 

54.  6% 

LCD  R 

65.  H 

34.  9% 

LT 

5  4.  If, 

45.  9% 

LTJG 

79. 7S 

20.  3% 

ENS 

00 

o 

• 

o 

20.  Of 

Distribution 

By  Total  Sample 

64. 6f 

35.  4f 

An  analy 

sis  of  question 

A 39  indicates  a 

more  posi- 

tive  ratio  for  OEMS,  nearly  -‘■wo 
support  is  not  overwhelming. 

to  one  in  favor. 

7et  the 

Question 

A40  poses  this 

issue  on  another 

dimension 

rightness  for  selection  and  promotion  functions.  Table  XXIII 
has  the  results. 


A40  "As  an  organization,  we  are  doing  the  right  thing  by 
using  this  system  (OPMS)  as  the  basis  for  promoting 
qualified  ofriesrs." 

The  response  to  this  issue,  A40,  is  nearly  the 
reverse  of  the  previous  results.  This  may  indicate  clear 
ambivalence  of  the  officer  corps  concerning  the  separate 
issues  pcsed  by  the  questions. 

The  OEMS  is  a  system  of  management  by  objectives 
(MBO) .  One  cannot  deny  this  fact.  Attempts  to  disguise  this 
basic  issue  may  he  perceived  as  insulting,  if  not  at  least 
condescending,  by  the  the  corps.  The  officer  corps  is  not 
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TABLE  XXIII 

OPUS  Pits  Selection  /  Promotion  ? 


A  40 

Agree 

Do  not  Agree 

Capt 

35.0% 

65.  0% 

CDR 

22.7% 

77.  3% 

LCD  R 

30.6% 

69.  4% 

LT 

26.2% 

73.  8% 

LTJG 

32.8% 

67.  2% 

ENS 

ui 

o 

• 

o 

a* 

50.  0% 

Distribution  by 

Total  Sample 

30.5% 

69.  5 % 

opposed  to  MOB, 

per  se,  as  may 

have  been  feared  ?r 

eviousi v. 

By  testing  the 

attitudes  of  Coast  Guard  Officers 

relevant 

to  MBO  ,  quest! 

or  A41  attempts 

to  measure  how  the 

coprs , 

overall,  perceives  the  "  rightness  of  fit  "  for  MBO  and  the 
Coast  Guard.  Table  XXIV  de monstrates  the  response  of  the 
sample  ic  the  issue  of  "  rightness  "  of  MBO  for  the  Coast 
Guard  officer  management  system. 


A41  "Management  by  objectives  is  an  appropriate  aporcach 
to  military  personnel  management  for  use  in  tae  Coast 
Guard." 

A  summary  of  these  data  on  MBO  indicates  a  fair 
support  base  for  MBO,  at  least  superficially. 

7.  Do  We  Re allv  Know  Enough  to  be  Fair? 

Equity  is  an  ever  present  issue  in  evaluating  the 
efficacy  and  acceptance  of  an  appraisal  system.  To  be  fair — 
to  one's  self,  as  well  as  to  others —  requires  a  degree  of 


TABLE  XXI? 


MBO  Right  Personnel  Management  ? 


A41 

Agree 

Do  not  Agree 

Capt 

65.0s? 

35.0% 

CDR 

63.7% 

36.  3% 

LCDS 

56.5% 

43.  5 % 

LT 

64.0% 

36.  0% 

LTJG 

71.9% 

28.  1% 

ENS 

70.0% 

V*. 

o 

• 

o 

rn 

Distribution 

By  Total  Sample 

64.6% 

35.  4% 

knowledge  ccnerning  the  integration  and  articulation  of  this 
system,  OPMS  ,  and  its  relationship  with  the  promotion  and 
selection  process  as  well  as  other  human  resource  programs. 
To  measure  the  perceptions  of  the  officer  corps  on  this 
feature,  equity,  questions  &12,  SK5 ,  SK6,  and  SK7  were  used 
in  the  survey. 

Question  A12  poses  the  issue  of  clarity  in  the  use 
of  numbers  in  the  OPR.  Essentially,  for  the  assignment  of 
any  evaluation  tc  be  equitable,  the  constructs  used  to  make 
up  that  evaluation  must  be  clear  to  all.  There  is  no  room 
for  confusion  on  marks.  Table  XXV  provides  the  breakdown  of 
the  response  to  this  issue. 


A 12  "The  documentation  and  instructions  orovided  with 
the  OPMS  assure  there  is  no  confusion  in  assigning 
numerical  evaluations  to  Coast  Guard  officers." 


TABLE  XXV 


Instructions 

Preve  nt 

Couf usion 

A 12 

Agree 

DO 

not  Agree 

Capt 

b? 

O 

• 

in 

T- 

85.  0% 

CDS 

9.1% 

90.9% 

LCD  R 

11.67. 

88.4% 

LT 

8.2% 

91. 8« 

LTJG 

27.0% 

73.  0% 

tf  NS 

20.0% 

80.0% 

Dis tr ibution 

By  Total  Sample 

16.0% 

o 

t 

c* 

CO 

The  response  to  the  issue,  as  presented  by  question 
A 12 ,  clearly  poirts  to  a  problem  for  the  OPflS.  Again,  those 
who  most  use  the  OPMS  are  those  most  negative  .  This  is  an 
alarmina  response  to  the  author.  It  is  a  cause  for  great 
concern  for  those  who  would  seek  to  improve  any  facet  of  the 
CPUS. 

To  test  this  issue  further.  Questions  SK5  and  SK6 
ask  for  response  concerning  the  assignment  of  numbers  on  the 
OPH  and  the  subsequent  impact  of  the  numbers  that  might  be 
assigned.  The  results  are  shown  in  Table  XXVI  and  Table 
XXVil  respectively. 


SK5  "The  numerical  evaluation  of  three  is  what  the 
majority  of  officers  should  receive.” 
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TABLE  XXVI 


Most 

Officers 

Receive  3's 

SK5 

Agree 

Do  not 

Capt 

6-5.0% 

35.  0% 

CDR 

52.4% 

47.6% 

LCDF. 

6  2.8% 

37.  2% 

LT 

57.6% 

42.  4% 

LTJG 

5  3.1% 

42.  9% 

ENS 

8  0.0% 

20.0% 

Distribution 

By  Total  Sample 

59.2% 

40.  8% 

on  OPR? 


agree 


The  response  to  question  SK5  is  inconclusive  by 
itself;  it  merely  shows  ambivalence  regarding  the  assignmen 
of  the  number  three  on  the  OPR.  Yet,  when  question  SK5  is 
considered  with  these  data,  then  the  confusion  on  this 
matter  becomes  apparent.  Many  officers  think  that  it  is 
proper  to  assign  the  majority  of  officers  the  number  three; 
yet,  they  overwhelmingly  perceive  that  a  three  is  insuffi¬ 
cient  fcr  promotion.lt  would  be  logical  to  infer  that  these 
same  officers  would  fester  the  nonpromotior.  of  the  majority 
of  the  corps;  yet,  this  is  obviously  not  the  case  in  fact! 
Thus,  the  ambivalence  results  from  confusion  regarding  the 
process  of  assigning  numbers  to  the  DPR  and  lack  of  clarity 
concerning  their  impact  on  promotion.  Certainly,  this  issue 
looms  tc  block  successful  integration  and  acceptance  of  the 
OPM  S. 


SK6  "The  numerical  evaluation  of  three  is  sufficient  to 
assure  the  proaoticn  of  a  qualified  officer." 


73 


TAB  IB  XXVII 

A  3  is  Sufficient  for  Promotion? 


SK6 

Agree 

Do  no 

Capt 

— k 

O 

• 

o 

O 

• 

o 

COR 

4.8% 

95.  27 

LCDR 

10.7% 

89.  3% 

IT 

11.9% 

88.  1% 

LTJG 

22.2% 

77.  8% 

ESS 

20.0 % 

80.  0% 

Distribution 

By  Total  Sample 

64.6% 

35.  4% 

The  equity  cf  the  OPMS  is  further  explored  by  ques¬ 
tion  SK7.  This  question  probes  the  issue  of  fairness  as  a 
function  of  system,  knowledge.  Table  XXVIII  shews  the 
response  the  responses  to  this  issue. 


SK7  "I  am  satisfied  that  I  knew  epough  concerning  the 
value  of  numerical  marks  to  be  fair  to  avself  ana 
others." 

The  strength  of  this  response,  when  viewed  in  the 
context  of  the  preceeding  two  questions,  indicates  an  area 
of  concern  for  tie  OPMS.  The  dichotomy  of  response  on  ques¬ 
tions  SK5  and  S K 6  points  no  confusion.  The  stark  statement 
gathered  in  SK7  indicates  summarily  that  the  groundwork  for 
inequity  has  beer,  laid  and  may  well  permeate  the  OPMS  unless 
this  issue  is  dealt  with.  Clearly  90.0*  of  the  senior  offi¬ 
cers  polled  are  confused  on  these  issues.  There  is  basis  for 
alarm  here. 
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TABLE  XXVIII 

Me  Know  Enough  to  be  Pair? 


SK7 

Agree 

Capt 

25.0% 

CDS 

23.8% 

LCDR 

17.6% 

LT 

13.3% 

LTJG 

16.1% 

EWS 

20.0% 

Distr  ib  utior. 

By  Total  Sample 

17.4% 

75.  ?< 
76.2% 
32.  41 
86.7% 
3  3.9% 
80.0% 

8  2.6% 


8.  Do  Sj  Kflcw  What  Per  fora an ce  is  Neccessary  for 

Pro  mot  i  or.  ? 

The  objectives  of  appraisal  systems  may  be  many  and 
varied.  The  essertial  ingredient  is  “hat  they  are  deli¬ 
neated.  A  specific  function  of  the  OPUS  is  the  link  of 
appraisal  tc  pro  notion.  An  appraisal  system  so  linked  to 
promotion  can  be  most  effective  by  clearly  and  consistently 
advertising  and  rewarding  the  global  set  of  behaviors, 
activities,  and  actions  that  it  desires  of  those  whom  it 
would  serve  to  promote.  Behaviorists  teach  us  that  an  organ¬ 
ization  may  best  modify  behavior,  or  develop  the 
professionalism  cf  the  officer  corps,  by  effectively  adver¬ 
tising  what  behavior  is  desired,  and  then  stroking  that 
behavior  through  the  organizational  reward  system,  that  is 
the  appraisal  system.  To  this  end,  an  appraisal  system  oust 
have  clear  goals  and  clear  rewards.  The  path  between  the  zwo 
needs  tc  be  clear,  consistent,  and  unobstructed. 

To  measure  the  perceptions  of  the  officer  corps 
regarding  this  issue,  guest  ions  R25,  SK12a,  and  SK12b  were 
used. 
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Question  R25  poses  the  issue  of  clarity  versus 
confusion  concerting  numbers  which  are  assigned  to  an  offi¬ 
cer's  OPR,  and  the  impact  of  those  numbers  on  promotability. 
The  paradigm  is,  essentially,  that  where  confusion  reigns, 
clarity  of  purpose  is  lost.  Table  XXIX  displays  the  overall 
reaction  of  the  sample  to  this  issue. 


R25  "I  am  confused  concerning  the  impact  that  the 
numbers  on  the  OPR  have  on  tne  promotability  of  offi¬ 
cers." 


TABLE  XXIX 

numbers  and  Promotability  Confusing? 


R25 

Agree 

Do  not  Agree 

Capt 

68.  U% 

31.6% 

CDR 

77.3* 

22.1% 

LCD  R 

77.9% 

22.  1% 

LT 

82.0% 

18.  0% 

LTJG 

81.2% 

18.  8% 

ENS 

80.0% 

20.  0% 

Distribution 

By  Total  Sample 

79.0% 

21.  0% 

The  response  to  S25  is  quite  revealing.  Clearly 
70. 0%  of  the  senior  officers  polled  are  not  certain  of  the 
impact  their  appraisals  nay  have  .  This  type  of  uncertainty 
breeds  the  inflationary  trends  that  were  cited  as  the  basis 
for  scrapping  the  previous  PA  system,  the  Officer  Fitness 
Reporting  System. 


This  issue  is  further  explored  with  questions  SK 1 2 A 
and  SK12B.  Here  the  issue  is  whether  the  OPMS  helps  an 
officer  to  determine  which  performance (s)  are  organization¬ 
ally  rewarded  with  promotion.  The  summary  results  are  shown 
in  Table  XXX  and  Table  XXXI. 

SK12A  "My  knowledge  of  the  OPMS  enables  me  to  determine 
what  performance  as  necessary  to  assure  the  promotion 
...  of  deserving  juniors." 


TABLE  XXX 

Know  What  is  Required  of  Juniors? 


SK12A 

Agree 

Do  not  Agree 

Capt 

15. Of. 

35.0* 

CDR 

19.0* 

b* 

O 

• 

r— 

00 

LCDR 

21. 6% 

t*. 

• 

CD 

r- 

IT 

6.9% 

93.  1% 

LTJG 

2  2 . 0% 

78.0% 

ENS 

14.3% 

85.7% 

Distribution 

By  Total  Sample 

17.1% 

82.9% 

SK12B  "My  knowledge  of  the  OPMS  enables  me  to  determine 
what  performance  as  necessary  to  assure  the  promotaon 
. ..  of  myself." 
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TABLE  XXXI 

Know  Shat  is  Required  of  Self? 


SKI  2B 

Agree 

Capt 

15.055 

CDF. 

14.3% 

LCDS 

20.035 

LT 

o 

• 

o 

LTJG 

26.5% 

ENS 

20.0% 

Distribution 

By  Total  Sample 

18.5% 

Do  not  Agree 
35.5% 

85.  7% 
80.0% 
90.0% 

73.  5% 
80.0® 

81.  5% 


The  responses  to  these  last  two  questions  demons¬ 
trate  unequivocally  that  the  officer  corps  does  not  know 
what  performance  is  necessary  to  assure  promotion  and  that 
the  OPMS  does  little  to  fester  the  type  of  performance 
desired  fcy  the  service,  since  it  is  unknown  .  Multitudes  of 
behaviorists  would  find  this  to  be  quite  alarming.  Given 
that  a  stated  objective  of  the  OPMS  was  the  growth  and 
development  of  the  officer  corps,  one  might  conclude  that  it 
has  failed  to  meet  its  objectives  on  the  basis  of  these  last 
two  responses. 


B.  CONCLUSIONS 

These  findings  tend  to  support  the  thesis  put  forth  by 
Ehatia  in  a  studj  of  personnel  appraisal  in  government 
[Ref.  35].  Bhatia's  study  discloses  that  fewer  than  8.3% 
of  the  Fortune  5C0  companies  report  highly  successful  MBO 
implementations.  He  goes  on  to  question  the  efficacy  of  M30 
in  government  organization  by  asking  bluntly,  "  Can  it 
really  work?” 
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The  initial  analyses  of  the  survey  results  indicate  that 
the  support.  base  requisite  for  success  does  not  exist  today 
in  the  (J.S.  Coast  Guard.  Rather,  there  is  at  best  a  lukewarm 
acceptance  of  the  service’s  major  M30  effort,  the  OPMS. 

Where  there  is  resistance  to  the  OPMS,  it  is  rampant. 

The  respondents  to  this  study,  and  by  extension,  the 
Coast  Guard  Officer  Corps,  show  high  resistance  to  the  OPMS 
in  areas  of  (1)  uniform  applicability  cf  the  system,  (2) 
payback —  whether  it  is  worth  the  effort,  (3)  priority — 
that  it  interferes  with  existing  priorities,  (U)  organiza¬ 
tional  context —  whether  it  is  right  for  the  service,  (5) 
equity--  that  it  may  not  fairly  measure  performance  or 
potential,  and  (6)  reward  structure —  that  the  system  does 
not  adequately  identify  behaviors  necessary  for  promotion 
and  consequently  does  not  stroke  positive  behavior.  As  a 
result,  it  should  come  as  no  surprise  that  there  is  an  over¬ 
whelming  felt  need  for  improvement  or  change  to  the  OPMS. 

1 .  Uni form i ty 

The  analyses  reveal  unquestionably  that  the  OPMS  is 
percieved  to  be  applied  to  the  officer  corps  in  a  non- 
uniform  fashion.  The  officer  corps  believes  that  the 
application  of  the  OPMS  is  a  function  cf  grade,  career 
field,  and  district  cf  assignment.  The  author  will  not 
debate  whether  this  belief  is  based  in  fact  or  not.  The 
reality  is  that  the  officers  believe  it  to  be  true.  This  is 
a  devastingly  decisive  perception  that  may  have  negative 
consequences  not  only  for  the  OPMS,  but  for  corps  unity  as 
well. 


2 .  Payback 

The  analyses  of  the  data  support  the  position  than 
the  OPMS  is  not  wort’;  the  time  and  effort  it  requires,  that 
the  organization  el  payback  for  using  the  system  does  not 
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foster  its  use.  This  perception  of  the  officer  corps  may 
prevent  the  OPUS  from  being  accepted  as  the  thing  to  do.  Th 
OPSS  in  its  present  form  may  take  a  back  sear  to  more 
rewarding  tasks. 

3 .  Priority 

The  analyses  of  the  data  support  the  position  that 
there  is  not  enough  time  for  the  new  priorities  mandated  by 
the  OP MS.  This  system  hinders  the  performance  of  other 
primary  and  collateral  duties  performed  by  the  senior  offi¬ 
cers  polled.  The  OPMS  will  likely  be  placed  on  the 
proverbial  "back  burner"  as  intervening  priorities  override 
the  demands  of  the  OPKS. 

h .  Organizational  Context 

The  analyses  of  the  data  support  the  position  that 
the  0 PMS  is  only  moderately  veil  fitted  into  the  organiza¬ 
tional  context  of  the  Coast  Guard.  While  there  appears  to  b 
moderate  support  for  the  OPMS  in  the  supervision  and  growth 
functions,  there  is  abject  opposition  to  the  system  in  the 
selection  and  pr  emotion  functions.  The  OPJIS  must  be  more 
closely  tailored  to  the  organizational  context  of  the  Coast 
Guard  to  gain  greater  acceptance. 

5 .  Equity 

The  analyses  of  the  data  strongly  support  the  posi¬ 
tion  that  the  OPES  is  inherently  unfair,  even  at  this  early 
stage,  because  of  the  widespread  confusion  concerning  the 
impacts  and  uses  of  the  numbers  and  the  limited  under¬ 
standing  by  the  corps  of  the  value  of  numerical  marks  when 
assigned.  This  issue  of  inequity  must  be  viewed  in  the 
greater  context  cr  the  links  among  performance  evaluation, 
promotion,  and  the  career  impacts  of  successive  non¬ 
selection.  The  Officer  Fitness  Reporting  System,  which  was 


replaced  by  the  CPUS,  was  replaced  in  a  large  part  due  to 
these  issues.  It  is  inappropriate  to  bridle  ourselves  with  ?. 
massive  appraisal  system  that  is  not  at  least  incrementally 
more  effective  ir  this  dimension  than  the  one  it  replaced. 

6 .  Reward  Structure 

The  analyses  of  the  data  support  the  position  that 
the  officer  corps  does  not  know  what  performance  is  neces¬ 
sary  for  promotion  and  that  the  0FM3  does  little  to  foster 
the  type(s)  of  performance  desired  by  the  service,  since 
that  performance  is  unknown.  Behaviorists  tell  us  that  it 
is  appropriate  to  stroke  desired  behavior  ir.  order  to  rein¬ 
force  that  behavior.  This  appraisal  process  does  not  stroke 
desired  behavior,  largely  because  that  behavior  remains 
undefined  by  the  OPMS.  Behavioraily  anchored  rating  scales 
(3AR3)  have  not  had  the  desired  effect  in  this  regard. 

7.  Need  for  Change 

The  analyses  of  the  data  overwhelmingly  support  the 
position  that  there  is  a  felt  need  for  change  to  the  Op'is  . 
Exactly  what  charge  and  when  is  unclear.  However,  the 
previous  six  dimensions  certainly  reflect  conditions  that 
are  ripe  for  improvement  The  perceptions  of  the  corps, 
whether  accurate  or  not,  are  truly  what  will  drive  this 
appraisal  system  to  success  or  failure.  It  is  not  too  early 
at  this  point  to  focus  attention  cn  apparent  trouble  spots 
within  the  system. 

C.  WHERE  TO  GO  ?ROM  HERE  ? 

The  preliminary  analyses  of  the  data  collected  by  this 
research  effort  indicate  the  foregoing  conclusions  to  be 
substantially  supportable.  Additional,  in-depth  analyses  of 
these  data  most  assuredly  will  support  the  conclusions 
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implied  herein  .  It  is  toped  end  intended  that  the  Coast 

Guard  Headquarters  (G-OPES)  staff  vz.ll  use  these  data  for 
tba  betterment  of  the  appraisal  systems  to  the  collective 
good  of  all  Coast  Guard  officers.  This  research  project: 
reveals  the  collective  response  of  a  highly  representative 
sample  of  the  officer  corps.  Their  frank  opinions  should  not 

go  unheeded. 


I 


•v* 


APPENDIX  A 

OPUS  STUDY:  THE  SURVEY 


In  t  ro  duct  ion 


Thank  You.,  for  -taking  the  time  to  participate  in  this 
survey.  Hcpefully,  it  will  not  require  more  than  30  minutes 
to  complete. 

We  would  like  to  have  ycur  FRANK  RESPONSE  to  the 
following  questions.  These  questions  concern  the 

operation  of  the  Officer  Performance  Management  System 
(0PM S)  .  We  hope  to  learn  of  vo  ur  present  Reactions, 
Attitudes,  and  Knowledge  concerning  this  system. 

The  information  gained  from  the  analysis  of  your 
responses  will  be  used  at  Headquarters  to  evaluate  the 
ef f ecniveness  of  the  Officer  Performance  Management  System 
(CP  MS  f  . 

Additionally,  your  responses  will  form  an  essential 
portion  of  a  research  project  at  rhe  Naval  Postgraduate 
School,  Monterey,  California.  This  project  is  beina 
ccn  ducted  by  a  coast  Guard  Officer. 

You  have  been  selected  through  a  random  process.  This 
piocess  intends  to  sample  the  opinion  of  a  representative 
cross-section  of  active  duty  Coast  Guard  officers. 

Ycur  responses  will  be  (1)  Anonymous  and  (2) 
Confidential.  There  is  no  mechanism  included  in  this  survey 
designed  tc  link  the  remarks  back  to  the  individual  makir.o 
these  remarks. 

Knowing  this,  we  hope  you  will  be  encouraged  to  make 
frank  and  honest  responses  tc  the  qusst ionnaire. 

We  will  ask  you  for  some  limited  demographic  informa¬ 
tion.  This  will  be  used  to  validate  the  sampling  process. 

It  is  important  to  us  to  know  the  type  of  officers 
responding  to  this  survey.  This  information  will  have  no 
other  usage. 

For  clarity, the  use  of  abbreviations  in  this  questic- 
raire  is  limited.  The  following  terms  will  be  abbreviated: 


Officer  Performance  Management  System  (OPMS) 

Officer  Support  Form  (OSF) 

Officer  Performance  Report  (OPR) 

Leadership  an.d  Management  School  (LAMS) 


Thank  You 
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Demographics 


Please  indiecte  vour  response  to  each  of  the  following 
guestiors  and  suiguestions  by  placing  a  check  mark  in  the 
parentheses  ( _ )  . 


Example 


What  is  ■‘he  color  of  your  eyes? 


a)  Elue 

b)  Brown 

c)  (5  re e  xi 

d)  Other  (Please  Specify) 


Miss 

101 


End  of  Example 


(1)  What  is  (are)  your  present  role(s)  in  the  OPMS 
process? 


My  role 
(a) 


ncludes  action 


t  ’:e 
lb 
(c 
(d 
(€ 


reDorted  on  officer.  (127) 
as  the  supervising  officer, 
as  the  reporting  officer, 
as  the  reviewer  officer. 
Other  (Please  specify) 


64 

40 

33 

01 


(2)  Hew  many  reporting  cycles  have  you  completed? 


fi 

% 

(e) 


or.e  cycle 

two  cycles 

three  cycles 

This  is  my  first  cycle. 

Other  (Please  specify). 


(«)> 

o?! 
01 
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(3)  Ir.  general  terms,  what  is  your  area  of  career 
specialty? 


(a 

Surface  Operations 

68) 

b 

A  viaticn 

47 

c 

Engineering 

5  0 

d 

Marine  Inspactron/Protection 

50 

6 

M anpower/Per  s/Tr aining /Education 

21 

I 

i  Financial/Lo  grstics 

Legal 

i  Other  (Please  specify) 

08 

07 

09 

(4)  Where  is  your  present  assignment? 


Afloat  (40)  Ashore  (225) 
Duties  Assigned: 


CO  (28 )  XO  (19)  20  (04)  OPS  (07)  DIEOPS(18) 

DIVCH  (24)  SBCH  (22)  DEP3HCH  (30)  OTHER  (113) 


(5)  What  is  your  present  grade? 


(a 

Captain 

20 

(b 

C  emmander 

22) 

(c 

Lieutenant  Commander 

86 

(d 

L  ieuteaant 

62) 

[o 

L  ieuter.ant  { j  unior  grade) 

64) 

{f 

E  rsigr. 

1 0 

(g 

Warrant  ( W 1  through  W4) 

00) 

(6)  How  aany  officers  do  you  report  on  as  a  super¬ 
visor? 


_ _ _  (Please  enter  the  correct  number) 

None  (130) 

1-3  (83)  Miss 

More  than  3  (  51)  01 

(7)  Hew  many  officers  do  you  report  on  as  a 
reporting  officer? 


_  (Please  enter  the  correct  number) 

None  (194) 
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Survey  Instructions 


Thank  You.,  for  coming  this  far  in  the  survey’ 

If  you  do  not  wish  to  continue,  please  seal 
edge  or  the  survey  booklet  and  return  it  by  mai 
We  will  te  sorry  if  you  don't  continue.  We  stil 
wish  to  thank  you  for  the  data  that  you  have 
provided  at  this  point. 

.If  yog  do  wish  t<?  continue ,  please  read  on.  Y 
vij.1  fine  the  questions  to  be  relevant  and  thou 
provoking. 

The  following  questions  are  designed  to  capt 
your  frank  opinions.  For  simplicity  in  scorincr 
aata,  most  quest-  ions  have  multiple-choice 
answers.  You  may  select  as  many  or  as  few  of  the 
responses  which  apply  to  you. 

In  the  event  that  we  have  not  been  able  to 
include  an  appro-  pnate  response  cDtion,  pleas 
provide  a  narrative  comment  which  best  describe 
veur  response.  Space  has  been  provided  at  each 
tion  for  this  purpose. 

For  the  questions  that  follow,  please  place  a 
check  (  )  m  the  parentheses  that  correspond  to 

your  response. 

Please  write  any  additional  comments  directly  on 
the  survey  form  in  the  space  provided. 


Again,  Thank  You. 
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O’  ,  .»  ’  01 0)  (!) 

cjri  n,d  « 

f  > O  O'  Z  i->  UWtJ’ 


(1)  Considering  all  of  your  experiences  so  fay 
with  the  OPMS  process,what  is  your  overall  reaction 
to  the  ertire  system? 


Very  po  siti  ve 
Positive 
Borderl ine 
Negative 
Very  Negative 


i®, 

597) 
39 
09 


MISS 

02 


(la)  fihat  is  the  best  part  of  using  OPMS? 

Counseling  (28)  Feedback  (76)  Other  (137) 


Missiig  (24) 


(1b)  How  good  is  this  best 


part  of  OPMS? 


(a)  Superior 
(bj  Outstanding 
(cj  Excellent 

(d)  Very  Good 

(e)  Good 

(f)  Borderline 


(17) 

(54) 

(89 

(49) 

(27 

10 


MISS 

15 


(1c)  What  is  the  worst  part  of 
Paperwork  (39)  Time  (108) 


using  OPMS? 
Other  (100) 


Missing  (19) 


(Id)  Row  bad  is  this  worst  part? 


Extremely  bad 
Very  bad 
Bad 

(Jnsatis  factory 
Poor 

Borderl ine 


55) 

43 

36 

S3“;. 

3«| 


MISS 

10 


Desk  Guide 


Very  positive 
Positive 
Borderline 
Negative 
Very  Negative 


[39) 

152) 

50) 

03) 

01 


MISS 

15 


COMDTINSTB  1611.  10 


(a)  Very  positive 

(b)  Positive 
(cj  Borderline 
jd)  Negative 

(e)  Very  Negative 


HISS 

10 


(3)  In  general,  what  is  your  reaction  to  tpe 
clarity  cf  directions  provided  by  the  following 
documents? 


Desk  Guide 


(a)  Very  positive  (23) 

(b)  Positive  (164) 

(c)  Borderline  (54) 

(d)  Negative  (06) 

(e)  yery  Negative  (01) 


HISS 

15 


COMDTINSTB  1611.  10 


Very  positive 
Positive 
Borderline 
Neaative 
Very  Negative 


MISS 

10 


(4)  ir  general,  what  is  your  reaction  to  the 
overaxl  consistency  of  the  directions  and  guidance 
provided  by  these  two  documents? 


(a) 


Very  positive 
Positive 
Ecrderl  ine 
Negativ  e 
Very  negative 


pif» 

07 

(01) 


MISS 

12 


(5)  Ir  general  ,  what  has  been  your  overall  reac¬ 
tion  to  the  feedback  you  have  received  during  the 
evaluation  cycle  (six  months).. 


from  your  supervisor? 


(a 

Very  positive 

,29 

to. 

i  Positive 

ii; 

(c 

Borderline  i 

65) 

id. 

Negative 

11 

(e 

Very  negative  - 

04 

(f 

i  None  received 

44 

from  your  reporting  officer? 


a)  Very  positive  (20 
h  Positive  (74 

ci  Borderline  (46 
d  Negative  (09 

e  Very  negative  c 031 
if)  None  received  (113) 

(6)  Ir  general-  what  is  your  overall  reaction  to 
the  negative  feedoack  you  may  have  received  during 
your  evaluation  cycle.. 

from  your  supervisor? 

(a)  Very  positive  (18) 

(b)  Positive  (89) 

(c  Borderline  (28) 

(<1  Negative  (17) 

(e  Very  negative  (02) 
if)  None  received  (111) 

from  your  reporting  officer? 

(a)  Very  positive  (07) 

1b)  Positive  (55 

<:)  Borderline  (34) 

d)  Negative  (08) 

e)  Very  negative  (02) 

:)  None  received  (159) 

(7)  Jr.  general-  what  is  your  overall  reaction  to 
the  positive  feedback  you  may  have  received  during 
your  evaluation  cycle... 

from  your  supervisor? 


(a)  Very  positive  (33) 

Ibj  Positive  (132) 

c)  Borderline  (43 
dj  Negative  (04 

e)  Very  negative  (00 

f)  None  received  (53 

from  your  reporting  officer? 

a)  Very  positive  (25) 

b)  Positive  (77) 

c)  Borderline  (43 

d)  Negative  (04) 

e)  Very  negative  (Oil 
if)  None  received  (11o) 


_  (8)  yY at  has.  been  your  reaction  to  the  accuracy 
of  the  irforaation  which  is  included  on  your  Officei 
Performance  Report,  as  the  Reported  on  Officer? 


Very  positive 
Positiv  e 
Borderl ine 
Negative 
Very  negative 


(37) 

m2) 

(57) 

(15)  aiss 
(05)  09 
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(9)  Hew  would  you  describe  the  skill  of  your 
superiors  in  providina  the  feedback  vou  have 
received  in  the  OPHS  cycle.. 


your  supervisor? 


(a; 

\  Very  competent 

:3i) 

b 

\  ComcetacT 

101 

c 

|  Borderline 

77) 

d 

I  Incompetent 

16 

:§ 

Very  Incompetent 

05 

(f 

[  None  received 

135 

your  reporting  officer? 


ai 

I  Very  competent 

33) 

b 

1  Competenn 

71) 

c 

)  Borderline 

57) 

(dj 

1  Incompetent 

07) 

e 

)  Very  Incompetent 

05 

(fl 

(  None  received 

92) 

(10)  Fow  much  training  on  your  OPMS  duties  have 
you  received  from  the  Coast  3 uard?  (Please  esti¬ 
mate.  ) 


Meeks _ Days _ Hours 


(10a)  Where  die  you  receive  this  training? 


(a 

(b 

S’ 


CG  TSACE1I  L.A.M.  S.  (08) 
Implementation  team  (111) 
On  the  job  training  (12) 
Coast  Guard  Seminars  (87) 
Other,  please  specify  (14) 


When? 


Combi  ration  (31) 


No  training  received  (02) 


(11)  Fow  much  training  on  supervision  and  evalua¬ 
tion  using  the  principles  of  objective  and  goal 
setting  have  you  received  from  the  Coast  Guard? 
(Please  estimate.) 


Weeks _ Days _ Hours 
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(11a)  Where  did  you  receive  this  traininq? 

(a)  CG  TRACEN  L.A.M. S.  (33)  When? 

ib  Implementation  team  (41 

(c  On  the  job  traininq  (20 

id)  Coast  Guard  Seminars  (43 
(e)  Other,  please  specify  (19 

Combiration  (28) 

No  training  received  (8  2) 


(12)  Row  much  trainina  on  interpersonal  rela¬ 
tions,  conflict  resolution,  or  counseling  techniques 
have  you  received  from  the  coast  Guard?  (Please 
estimate .) 


Weeks _ Days _ Hours _ 

(12a)  Where  did  you  receive  this  training? 

(a)  CG  TRACEN  L.A.M.  S.  (5°)  When? 


(a 

CG 

TRA 

CEN  L.A.M. S. 

5° 

<bl 

Imp 

lem 

entation  tea 

m 

18) 

(c 

on 

the 

job  train in 

g 

17) 

(d 

Coas 

t  G 

uard  Seminar 

2 

26) 

(e 

Othe 

r. 

please  spec:. 

fy 

36) 

Combiration  (35) 

No  training  received  (72) 


(13)  In  general,  how  would  you  describe  this 
training  overall? 


(a)  Exceptionally  good 
ib)  Somewhat  good 

ici  So-so 

d  Somewhat  poor 

e)  Exceptionally  poor 


MISS 

35 


(14)  In  general, wh^t  is  your  reaction  to  the 
adequacy  of  the  training? 


(a)  Very  adequate 

(b)  Adequate" 

(c)  Borderline 

id)  Inadequate 

ie)  Very  Inadequate 


(30) 

\n\ 

(35)  MISS 


r*  t- 


(15)  How  would  you  describe 
the  training  you  have  received 


the  effectiveness 
on  your  OPMS  duxie 


(a 

(b 

<5 

H. 


Very  effective 
Effective 
Eorderl ine 
Ineffective 
Very  Ineffective 


HISS 

08 


(1$)  How  would  you  describe  y<?ur  current  level  of 
training  regarding  your  counseling  and  appraisal 
duties? 


(a)  Very  adequate 

!b)  Adequate 
c)  Borderline 
d)  Inadequate 
e)  Very  Inadequate 


22 

(106) 

77) 

(40) 

09 


MISS 

1  1 


(17)  How  would  you  describe  the  ability  of  vour 
reporting  officer  in  performing  his  OFMS  counselling 
ana  appraisal  duties? 


(a)  Very  competent 

(b)  Competent 

(c)  Borderline 
Id)  Incompetent 

(e)  Very  Incompetent 


[29) 

108) 
87) 
21 
1 3 


MISS 

07 


Fleas  €  '  .'..cate  the  degree  to  which  you  agree  or 
disagree  w*.  the  following  statements  py  olacirg  a 
check  mark  ( _ )  in  the  appropriate  parenthesis. 


(18)  I  am  frustrated  when  I  try  to  get  definitive 
answers  concerning  the  significance  cf  the  numbers 
on  the  013. 


(a)  Strongly  agree 

(b)  Agree 
ic)  Neutral 
jd)  Disagree 

(e)  Strongly  disagree 


84) 

69) 

90 

20) 

08) 


MISS 

04 


In  general  ,  the  amount  of  time  required  for 
cuties  has  nox  been  excessive. 


(a)  Strongly  agree  (20) 

(b)  Agree  ,  (69) 

(c)  Neutral  (32) 


93 


[i 


Disagree  (64)  MISS 

Strongly  disagree  (79)  01 


(20)  In  general,  the  number  of  officers  I  super¬ 
vise 

is  not  excessive. 


(a 

(b 

<c 

<d 


Strongly  agree  (74) 

Agree  (88) 

Neutral  (52) 

Disagree  (03) 

Strongly  disagree  (07) 


KISS 

41 


94 
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NL 


I 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BURtAU  0»  STANDARDS  l%j  A 


.  (21)  In  general,  the  number  of  officers  I  super 

vise  and/or  report  on  is  about  right. 


Strongly  agre9 
Agree 
Neutra  1 
Disagree 

Strongly  disagree 


31 

74 

82 

21 

13 


MISS 

44 


(22)  In  general  .  my  superiors  have  been  able  to 
devote  enough  time  to  me  to  meet  ay  OPMS  needs. 


Strongly  agree 
Agree 
Neutra  1 
Disagre  e 

Strongly  disagree 


12) 

76) 

47 

74 

54 


(23)  Fight  now,  OPMS  takes  too  much  time  to  ac  it 
right. 


(a) 

I 

(d) 

(ej 


Strongly  agre* 
Agree 
Neutra  1 


Disagree 

Strongly  disagree 


[  44 
10 


MISS 

10 


(241  Eight  now,  I  really  like  using  the  OPMS  for 
counselirg  and  supervising  but  I  dc  not  like  the 
idea  of  using  it  as  a  basis  for  promotion. 


(a 

b 

c 

d 

e) 


Strongly  agree  (27) 

Agree  (54 

Neutral  (90 

Disagree  (631 

Strongly  disagree  (26 


KISS 

05 


(25)  1  am  confused  concerning  the  impact  that  the 

numbers  cn  the  OPS  have  on  the  promotability  of 
officers . 


(a 

(b 

<c 

<a 

(e 


wl  w*  -f  JL  7  cc 

Agree 
Neutra  1 
Disagre  e 

Strongly  disagree 


i 


HISS 

02 


Section  II 


Fleas  €  indicate  how  you  feel  concerning  the 
following  statements. 


(1)  The  OPBS  is  a  good  w^y ,  overall,  to  accom¬ 
plish  per-  formanca  evaluation  m  the  Coast  Guard. 


SI 

ir 

<e 


Strongly  agree  (17) 

Agree  (108) 

Neutral  (68) 

Disagree  (47) 

Strongly  disagree  (23) 


BISS 

02 


qua 


(2)  0«e  of  the  OPBS  is  a  aocd  way 
Iifiec  officers  for  promotion. 


to  selec-i 


(a) 

(b) 
<cj 
<d 
<e) 


Strongly  agree  (13) 

Agree  (93) 

Neutral  (81) 

Disagree  (59)  BISS 

Strongly  disagree  (27)  02 


The  OPBS  provides  me  with  the  information 
need  to  perform  my  duties. 


(a) 

(b 

lei 


Strongly  agree  (28) 

Agree  (106) 

Neutral  (49) 

Eisaaree  (59) 

Stronglv  disagree  (21) 


(4 )  The  OPBS  provides  me  with  the  information  I 
need  to  assess  my  promotion  potential. 


ja) 

b 

»; 


Strongly  agree 
Aaree 
Neutral 
Disaare  e 

Strongly  disagree 


BISS 

02 


(5)  The  OPBS  will  provide  the  promotion  boards 
with  the  information  needed  to  fairly  and  accurately 
promote  qualified  officers. 


(a)  Strongly  agree  (08) 


96 


<b)  Agree 
(c)  Neutral 
<d  Disagree 
(e)  Strongly  disagree 


(50 

87 

,74 

,42 


97 


(6)  A  primary  function  of  the  OPMS  is  to  provide 
accurate  information  to  help.. 


(a)  promotion  boards  to  select  qualified  officers 

for  promotion.  (50) 

(b)  assignment  panels  tp  select  qualified  offi¬ 
cers  for  appropriate  positions.  (06) 

(c)  detailers  to  make  assignent  decisions.  (05) 

(d)  provide  performance  feedback  to  enhance  the 
personal  growth  of  the  officers  corps.  (101) 

(e)  Other  (Please  specify)  (10) 

Combiraticn  above  (  92) 

Missing  (01) 

(6a)  Shich  function  cf  the  OPMS  is  the  most 
important  to  you? 


(b 

II 

(e 


Promotion  boards 
Assignment  panels 
Detailer’s  decisions 
Performance  feedback 
Other  (Please  specify) 


Combiraticn  above  (20) 
Missing  (01) 


(7)  The 
tion  of  ny 


OPMS  provides  a  fair  and  accurate  evalua- 
past  performance. 


(a) 

p 

d 

(e 


Strongly  agree 
Agree 
Neutral 
Disagre  e 

Strongly  disagree 


07 
126) 
66) 
U2 
15 


MISS 

15 


(8)  The 
ment  of  ay 


OPMS  provides  a  fair  and  accurate  assess- 
future  potential  as  a  Coast  Guard  officer 


(a 

II 


Strongly 
Agree 
Neutral 
Disagre  e 
Strongl y 


agree 


disagree 


(06 

73 

96 

67 

17 


MISS 

06 


Strongl y  agree 
Agree 


98 


(c)  Neutral 

(as  Disagree 

}e)  Strongly  disagree 


106) 

66) 

50 


99 


(10)  The  OPMS  is  being  applied  uniformly  in  all 
career  fields  for  Coast  Guard  officers. 


jb 

r 

(e 


Strongly  aaree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


116 

61)  MISS 
47)  19 


(11)  The  CPUS  is  being  applied  uniformly  in  all 
duty  assign-  aents  throughout  the  Coast  Guard. 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


00) 
106) 
ill! 


MISS 

18 


(12)  The  documentation  and  instructions  orovided 
with  tne  OPHS  assure  there  is  no  confusion  ir. 
assigninc  numerical  evaluations  to  Coast  Guard 
Officers .' 


Strongly  agree 
Agree 
Neut ral 
Disagree 

Strongly  disagree 


03) 

39 

55L 

123) 

43) 


MISS 

02 


(13)  I  have  been  able  to  find  satisfactory 
answers  to  all  my  questions  concerning  the  cpms 
from  the  written  instructions  provided  with  the 
system. 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


(03) 

79) 

64) 

104) 

13) 


MISS 

02 


(13a)  The  Headguarters  (G-OPES)  Staff  have  been 
helpful  in  providing  satisractory  answers  to  the 
questions  I  have  posed  to  them  concerning  the  OFMS. 


(a 

ib 

c 

d 

e1 

f 


Stronal y 
Agree' 
Neut ral 
Disagree 
Strongly 
Dees  not 


agree 


disagree 
apply  to 


07 
33 
57 
18) 
,26{ 
125) 


MISS 

02 


(14)  ^he  training  provided  at  the  initial  stage 
of  OPHS  as  all  that  will  be  required  by  me  in  my 
career. 


100 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


(15)  So  farther  training  is  required  for  me  to 
perform  ly  OPMS  duties. 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


07) 

63 

4l{ 

.118) 

34)' 


MISS 

02 


(16)  So  further  training  is  Required  for  my  supe¬ 
riors  to  perform  their  OPUS  duties. 


(b 

S 

(e) 


Strongl y 
Agree 
Neut ral 
Disaare e 
Strongly 


agree 


disagree 


MISS 

03 


.  P 7) 

juniors 


No  further  training  is  required  for  my 
to  perform  their  OPMS  duties. 


(a 

!? 

6: 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


MISS 

25 


(18)  Ky  questions  concerninc  use  of  the  OPMS  can 
he  resolved  by  ay  immediate  rating  superiors. 


Strongly  agree 
Aqree 
Neutral 
Disagree 

Strongly  disagree 


(31) 


MISS 

03 


(19)  Mv  questions  concernina  use  of  the  OPMS  can 
be  resolved  by  Commandant  (G-OPES  Staff)  . 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disaaree 


08) 

81 

12h 

34) 

05 


MISS 

13 


J20) 
ment  of 


There  is  no  confusion  concerning  the  assign- 
ruaerical  evaluations  on  the  OPS. 


Strongly  agree 

Agree 

Neutral 


* 


102 


Disagree  (117)  mss 

(e)  Strongly  disagree  (74)  05 


(21)  1  have  no  questions  concerning  the  impact  of 

numbers  assigned  on  my  OPF. 


(a  Strongly  agree  (04) 

(b  Agree  (19) 

(c  Neutral  i  19). 

(d)  Disagree  (127 

(e)  Strongly  disaaree  (93) 


MISS 

03 


(22)  I  have  no  questions  concerning  the  impact  of 
the  numbers  I  assign  to  my  officers  on  their  OPB  (s) . 


(a)  Strongly  agree  (02) 

(b  Agree  (10) 

(c'  Neutral  (68) 

<d  Disagree  (8  3) 

(e  Strongly  disagree  (62) 


MISS 

40 


(23)  As  a  counseling  and  developmental  tool,  the 
OPMS  is  a  gocd  method. 


(a)  Strongly  agree 

(b)  Agree 

(c)  Neutral 
(a)  Disagree 

(e)  strongly  disagree 


147) 

27) 

09  MISS 
04  03 


(24)  The  time  and  effort  I  soend  on  documenting, 
counseling,  and  feedback  with  my  juniors  are  worth 


(a)  Strongly  agree  (34 

(b  Agree  (62 

(c  Neutral  73 

(d  Disagree  40 

(e)  Strongly  disagree  (13 


MISS 

43 


(25)  .  The  time  and  efforp  I  spend  on.  documenting, 
counseling,  and  feedback  with  superiors  are  worth 
it. 


(a)  Strongly  agree  42) 

(b  Agree  (92 

(c  Neutral  i  54 1 

Id'  Disagree  .  (53  MISS 

(e)  Strongly  disagree  (17)  07 


103 


into 


(26)  In  general  the  OPMS  pays  back  what  I  put 
o  it. 


SI 

If 

<e 


Strongly  agree  (34) 
Agree  (73) 
Neutral  (65) 
Disagree  (62) 
Strongly  disacree  (26) 


MISS 

05 


(27)  I  ha 
OPMS  duties. 


ve  enough  time,  on 


ay  job  to  perform  my 


Strongly  agree 
Agree 
Neutral 
Disagre  e 

Strongly  disagree 


10^) 

53i> 
43 


MISS 

02 


hinder^ 


Ihe  performance  of  my  OPMS 
the  performar.ee  of  my  other 


duties  does  not 
primary  duties. 


(a)  strongly  agree 

(bj  Agree 

(c)  Neutral 

id)  Disagree 

(e)  strongly  disagree 


20) 

103) 

3V 

6  2 

36 


MISS 

02 


u»fi? 


Ihe  performance  of  my  OPMS  duties  dpes  not 
the  performance  of  my  collateral  duties. 


b 


(a 

|c 

(d 


Strongly  agree 
Agree 
Neutral 
Disagre  e 

Strongly  disagree 


19) 

St1 


MISS 

03 


to 


supervisor  has  taken  enough  time  with  me 
to  complete  the  reports  required  by  OPMS. 


(a) 

'b 

c 

A 

(e) 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


(71 

(37 


MISS 

04 


(311 
typical 
on  ay  0 


104 


t.4.  WWW  «fc  J 

Agree 
Neutral 
Disagree 
Strongl y 


disagres 


04 

13 

58 

95, 

88) 


MISS 

07 


(32)  .  I  am  cot  afraid  to  risk 
stretching  ay  goals  or  the  OSF. 


failure  by 


Strongly  agree 
Agree 
Neutral 
Disa  gree 

Strongly  disagree 


31 

97) 

55) 

61) 

20 


MISS 

01 


still3i_ 
reach  all 


I  am  confident  that  ar.  individual  would 
e  selected  for  promotion  even  if  he  did  not 
of  his  goals  as  stated  on  the  OSF. 


(a) 

i| 

8 


Strongl y 
Agree 
Neutral 
Disagre  e 
Strong! y 


agree 


disagree 


(15) 

(128) 

(54) 

(48 

12 


MISS 

oe 


(34)  I  have  established  the  proper  rapport  with 
my  supe^fiscr  to  receive  an  accurate  perrormance 
evaluation. 


(b 

li 

<e) 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


25) 
136) 
57) 
27 
17 


MISS 

01 


(35)  My  supervisor  is  performing 
as  required  by  the  regulations. 


his  0? MS  duties 


I* 

4 

e 


Strongl y 
Agree 
Neutral 
Disa  gree 
Strongl y 


agree 


disagree 


MISS 

01 


(36)  So  improvements  to  the  OPMS  are  necessary  to 
ke 

t  an  effective  tool  for  performance  evaluation. 


Strongl y 

Agree 

Neutral 


agree 


105 


(d)  Disagree  (104)  MISS 

(e)  Strongly  disagree  (96)  02 


.a  43a 
officers 


Ko  improvements  to  the  OPMS  are  necessary 
an  effective  tool  for  selecting  qualified 
for  promotion. 


to 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


;°2) 

;i6 

58t 

110) 

76) 


MISS 

03 


(38)  Immediate  improvements  to  the  OPMS  are 
necessar j  to  make  i t  an  effective  tool  for  selecrina 
qualifiec  officers  for  promotion. 


jK 

HJ 

(e‘ 


Strongly  agree 
Aaree 
Neutral 
Disagr  e  e 

Strongly  disagree 


(55) 
(7  3) 
r  89) 
(35 
(08) 


MISS 

05 


.  (39)  As  $n  organization,  we  are  doing  the  right 
thing  by  using  this  system  (OPMS)  for  develcDmer.t 
and  supervision. 


!b! 

Si 

(e) 


Strongl y 
Agree 
Neutral 
Disagre  e 
Strongl y 


agree 


disagree 


48 

35 

f11 


MISS 

01 


(40)  As  an  organization,  we  are  doing  the  right 
thing  by  using  this  system  (OPMS)  as  the  basis 'for 
promoting  qualified  officers. 


(a)  Strongly 

(b)  Agree 

(c)  Neutral 

(d)  Disagree 
(ej  Strongly 


agree 

14 

[66) 

94 

65 

disagree 

f24 

MISS 

02 


(41)  Canagement  by  objectives  is  an  appropriate 
approach  to  military  personnel  management  for  use  in 
the  Coast  Guard. 


Strongly  agree 
Agree 
Neutral 
Disagre  e 

Strongly  disagree 


MISS 

02 


106 


Section  III 


(1)  Ir  general,  I  know  what  numerical,  evalua¬ 
tions 

to  assicn  my  officers  when  completing  the  OPS. 


(a)  Stror.gl  y  agree 

(b)  Agree 

(c)  Neutral 
id)  Disagree 

(e)  Strongly  disagree 


Ml 

74 

09! 


MISS 

48 


(2)  My  junior  ?f ficers  know  exactly  what  marks  to 
expect  or  the  basis  of  the  narrative  I  have 
provided . 


(a 

(b 

(c 

(d 

(e 


Strongl y 
Agree 
Neutral 
Disagre  e 
Strongl y 


agree 


disagree 


0  2) 

45L 

109) 


48 

07 


MISS 

54 


(3)  The  reportina 
marks  to  assign  when 
completed. 


officer  knows  what  numerical 
the  narrative  is  properly 


(a)  Strongly  agree 

(b)  Agree 

(c)  Neutral 
id)  Disagree 

(e)  Strongly  disagree 


03) 

62 

94 

79 

11 


MISS 

16 


The  following  questions  refer  to 
of  the  Officer  Performance  Hepor 
oast  Guard  Standards. 


& 


section  seven 
t.  Adherence  to 


,  (4)  A  numerical. evaluation  of  three  on  anv  item 

in  section  seven  is  an  excellent  mark. 


(a)  Strongly  agree 

(b)  Agree 

(c)  Neutral 
id)  Disagree 

(ej  Strongly  disaores 


MISS 

04 


107 


K I  »•  &■  <+ 


(51  The  numerical 
orlt 


majority  of 


evaluation  of  three  is 
officers  should  receive. 


what  the 


(a 

b 

c 

a 

e 


Strongly  agree 
Agree 
Neut ral 
Disagree 

Strongly  disagree 


}!&■ 

51 

11 


MISS 

04 


(6)  The  numerical  evaluation  of  three  j.s  suffi¬ 
cient  to  assure  the  promotion  of  a  qualified  oficer. 


Strongly  agree 
Agree 
Neutral 
Disagre  e 

Strongly  disagree 


05 

;30 

831 

109) 

31) 


MISS 

07 


(7)  I  am  satisfied  that  I  know  encygh  concerning 
he  value  of  numerical  marks  to  be  fair  to  mysexf 
nd  others. 


(a)  Strongly 

(b)  Agree 

(c)  Neutral 

(d)  Disagree 

(e)  Strongly 


agree  (05 

140 
55 
113 
46) 


MISS 

06 


(8)  I  am  satisfied  that  I  know  enough  concerning 
he  value  of  numerical  marks  to  advise  my  juniors 
hen  they  have  questions. 


(a 

(b 


c 


Agree 
Neutral 
Disagree 

rr 


Strongly  disagree 


MISS 

31 


(9  )  In  practice  this  section  is  always  written 
by  the  reporting  officer,  not  by  someone  else  at  his 
direction. 


Strongly  agree 
Agree 
Neutral 
Disagree 

Strongly  disagree 


20 

64 

77 

71 

25 


MISS 

08 


•  *-Oi 


This  concludes  the  questions  that  are  solely 
concerned  with  section  seven  (7)  of  the  OPR. 


(10)  f*y  supervisor  has  coaplied  with  the  OPMS 
counseling  requirements  without  undue  prompting  by 
me. 


(a)  Strongly  agree 

(b)  Agree 

(c)  Neutral 

(d)  Disagree 

(e)  Strongly  disagree 


25 

86 

35 

76, 

40) 


MISS 

03 


(11)  My  initial,  mid-period,  and  ena-of-perigd 
counseling  sessions  were  conducted  by  my  supervisor 
within  the  time  limits  established  by  Commandant. 


(a) 

Strongl y 

agree  (24 

(b) 

Agree 

(77 

(cj 

Neutral 

(29 

(a 

Disa  gree 

(90 

<e) 

Strongl y 

disagree  (41 

MISS 

04 


(12)  My  knowledge  of  tne.DPMS  enables  me  to 
etermme  what  performance  is  necessary  to  assure 
he  orcmction... 


of  deserving  juniors. 


a 

Strongly  agree 

,06) 

b 

Agree 

>34 

c 

Neutral 

83 

a 

Disagree 

88 

(e 

Strcngly  disagree 

25 

MISS 

29 


of  myself. 


(a)  Strongly  agree 

Ib)  Agree 
c)  Neutral 
d)  Disagree 
e)  Strongly  disagree 


MISS 

04 


(13)  I  am  certain  of  what  actions  are  required  of 
me  by  the  OPUS. 


Strongly  agree 
Agree 
Neutral 
Disa  gree 


15) 

179 

40) 

22) 


) 


MISS 


109 


(e)  Strongly  disagree  (07)  02 


(14)  3  know  which  office  to  call  in  my  Distric 
to  resolve  issues  of  conflict  concerning  the  OPMS 


Strongly  agree 
Agree 
Neutral 
Cisagre  e 

Strongly  disagree 


MISS 

10 


(15)  3  knew  which  office  to  call  at 

Headquarters  to  resolve  issues  of  conflict 
concernitg  the  OPMS. 


(a)  Strongly  agree  (27) 

(b  Agree  125) 

ic  Neutral  (32) 

(d  Disagree  62) 

(e)  Strongly  disagree  (16) 


MISS 

03 


(1 61 
out  all 


1  have  the  skills  that 
■y  OPMS  duties. 


are  required  to  carry 


(a 

<b 

ic 
d 
e 


Strongl y 
Agree 
Neutral 
Disa  gree 
Strongly 


agree 


disagree 


MISS 

03 


(17) 

carry  ou 


ave  the  skills  required  to 
lutias. 


Strong! y 
Agree 
Neutral 
Disagree 
Strongl y 


agree 


di sagree 


MISS 

03 


(18)  Py  juniors  have  the  skills  required  to 
carry  out  their  OPMS  duties. 


(a 

(b) 

c 

d 

e 


Strongly  agree 
Agree 
Neutral 
Disa  gree 

Strongly  disagree 


MISS 

38 


This  is  the  end  of  the  survey. An  additional  paqe 
is  provided  for  your  remarks. 


When  you  have  finished,  please  seal  the  edge  cf 
the  survey  booklet  with  tape  or  a  staple,  and  return 
it  by  mail. 


Ill 


C  cmments 


Please  us?  +he  remaining  space  to  provid 
whatever  additional  comments  you  may  nave. 
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OS  Coast  Guard 
Washington  ,E.C.  20593 


CW02  Stephen  B.  Wehrenberg, 
Commandant  (G-P-1/2/42) 

OS  Coast  Guard 
Washington,  C.C.  20593 
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13.  Super  intend®  rt 

OS  Coast  Guard  Academy 
Attn:  Earl  Pctter  . 

New  London  Connecticut  06320 
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Coaaandant  (G-P-3) 

OS  Cgast  Guard 
Washington  ,  r.C.  20593 


15. 


Coaaandant  (G-C) 
OS  Coast  Guard 
Washington  ,  r.C. 
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